tonybaldwin: xmlrpc posting with Xpostulate

tonybaldwin, 2010-04-06 08:01 pm UTC (Expand)

catness, 2010-04-06 08:06 pm UTC (Expand)

	no subject tonybaldwin 2010-04-06 08:00 pm UTC (link)
	Oh yeah, I've read the CODE, but it doesn't come with any documentation I can make sense of. The code is commented, but, still, can't figure out how it's sending the request. Figured I should clarify that. (Reply to this) (Thread from start) (Parent) (Thread) (Hide 1 comment) (Show 1 comment)

	no subject tonybaldwin 2010-04-06 08:03 pm UTC (link)
	The thing that sucks is, I keep getting "ok" back from the server, but the post doesn't appear on the journal. (Reply to this) (Thread from start) (Parent)

no subject

tonybaldwin
2010-04-06 08:15 pm UTC (link)

oh...that doesn't show the xml tags, of course.
but, I have the param and props and post all in the same [param][params][value][struct] [/struct][/params][/param]
Do they need to be separate?
ie;
headers here
[?xml version="1.0"?]
[methodCall][methodName>LJ.XMLRPC.postevent[/methodName]
[param]
[params]
[member][name]username[/name][value][string]tonytraductor[/string][/value][/member]
etc.
[/params]
[/param]
[param]
[params]
[member][name]prop_currentmood[/name][string]annoyed[/string][/value][member][/params][/param]
[param][params][member][name]event[/name][value][string]some text here...
this will be the post...yippee...
[/string][/value][/member]
[/param]
[/params]
[/methodCall]

(Reply to this) (Thread from start) (Parent)

no subject

catness
2010-04-06 08:15 pm UTC (link)

yes, params and props are different. Sorry I skipped over the xml data in your post without verifying if it's correct. here's a properly formed example (dumped my data stream while sending) :
<?xml version="1.0"?>
<methodCall>
<methodName>LJ.XMLRPC.postevent</methodName>
<params>
<param>
<value><struct>
<member>
<name>auth_challenge</name>
<value><string>blablabla</string></value>
</member>
<member>
<name>auth_method</name>
<value><string>challenge</string></value>
</member>
<member>
<name>auth_response</name>
<value><string>blablabla</string></value>
</member>
<member>
<name>day</name>
<value><int>6</int></value>
</member>
<member>
<name>event</name>
<value><base64>aGVsbG8gd29ybGQKLS0tLS0KaGVsbG8KLS0tLS0=</base64></value>
</member>
<member>
<name>hour</name>
<value><int>23</int></value>
</member>
<member>
<name>lineendings</name>
<value><string>unix</string></value>
</member>
<member>
<name>min</name>
<value><int>9</int></value>
</member>
<member>
<name>mode</name>
<value><string>postevent</string></value>
</member>
<member>
<name>mon</name>
<value><int>4</int></value>
</member>
<member>
<name>props</name>
<value><struct>
<member>
<name>current_mood</name>
<value><string>awake</string></value>
</member>
<member>
<name>current_moodid</name>
<value><int>87</int></value>
</member>
<member>
<name>opt_backdated</name>
<value><int>0</int></value>
</member>
<member>
<name>taglist</name>
<value><string>hello, world</string></value>
</member>
<member>
<name>useragent</name>
<value><string>QTXPost/0.3.0</string></value>
</member>
</struct></value>
</member>
<member>
<name>security</name>
<value><string>public</string></value>
</member>
<member>
<name>subject</name>
<value><string>test</string></value>
</member>
<member>
<name>username</name>
<value><string>my_username</string></value>
</member>
<member>
<name>ver</name>
<value><int>1</int></value>
</member>
<member>
<name>year</name>
<value><int>2010</int></value>
</member>
</struct></value>
</param>
</params>
</methodCall>

(Reply to this) (Thread from start) (Parent) (Thread) (Hide 14 comments) (Show 14 comments)

no subject

tonybaldwin
2010-04-06 08:30 pm UTC (link)

This is the kind of thing I'm not finding sufficiently explained in the existing documentation.
I hate that.
How'd you post with the < in there?
I seem to be missing some stuff, too.
(auth_challenge, auth_method, auth_respons...don't know what needs to be in there (sure it's not "blablabla", too), haven't seen it)
So, clearly, I have some more learning to do, but, the thing is, the documentation I have found is woefully inadequate in explaining this things...at least for a rather novice programmer, such as myself.

(Reply to this) (Thread from start) (Parent) (Thread) (Hide 13 comments) (Show 13 comments)

no subject

catness
2010-04-06 08:37 pm UTC (link)

Never mind auth_challenge, I suppose it should work with plain passwords for a start - but have a look at http://www.livejournal.com/doc/server/ljp.csp.xml-rpc.getchallenge.html (I can explain further if you need)
(and I've replaced the real data with blablabla just in case, for security - the challenge is supposed to expire after posting, but I'm a bit paranoid)

Also, probably you don't have to base64-encode the post content, unless you post in non-English languages with weird characters.

For using angle brackets, replace them with > and < ;)

The LJ documentation is a bit terse, that's right... but you'll get the hang of it eventually!

(Reply to this) (Thread from start) (Parent) (Thread) (Expand) (Hide 12 comments) (Show 12 comments)

(Deleted post)

tonybaldwin, 2010-04-06 08:44 pm UTC (Expand)

catness, 2010-04-06 08:50 pm UTC (Expand)

catness, 2010-04-06 08:59 pm UTC (Expand)

tonybaldwin, 2010-04-06 09:31 pm UTC (Expand)

catness, 2010-04-07 04:57 am UTC (Expand)

catness, 2010-04-07 08:30 am UTC (Expand)

tonybaldwin, 2010-04-07 02:37 pm UTC (Expand)

tonybaldwin, 2010-04-07 02:38 pm UTC (Expand)

tonybaldwin, 2010-04-07 02:45 pm UTC (Expand)

catness, 2010-04-07 02:58 pm UTC (Expand)

tonybaldwin, 2010-04-07 04:09 pm UTC (Expand)

tonybaldwin, 2010-04-07 04:11 pm UTC (Expand)

curioser and curioser

tonybaldwin
2010-04-07 03:27 pm UTC (link)

Okay, I'm trying to use tdom (tcl parser) to get the challenge var.
I'm doing:

set getchal "<?xml version=\"1.0\"?>
<methodCall>
<methodName>LJ.XMLRPC.getchallenge</methodName>
<params>
<param>
<value><struct>
</struct></value>
</param>
</params>
</methodCall>"

set getchallenge [http::geturl http://www.livejournal.com/interface/xmlrpc -query $getchal -type "text/xml" ]
set mychal [http::status $getchallenge]
set doc [dom parse $mychal]
set root [$mychal documentElement]
set nodeList [$root selectNodes {descendant::a}]
set chalvar {}

foreach node $nodeList {
set attList [$node attributes *]
foreach attribute $attList {
if {[string tolower $attribute] == "c0:"} {
set mychal [$node getAttribute $attribute]
break
}
}
}

But apparently http::meta or http::status is NOT the response from the server that needs to be parsed to grab me the infor (challenge variable c0:blablablab) that I need.
Because tdom keep throwing an error, suggesting that what I'm feeding (which, I thought was the server response) it is not valid xml.

(Reply to this) (Thread) (Hide 11 comments) (Show 11 comments)

Re: curioser and curioser

tonybaldwin
2010-04-07 03:28 pm UTC (link)

wait...
does $getchal actually need something in the params/param/value/struct?
Because, I just copied from your post http://catness.dreamwidth.org/61674.html
Do I need to include username/password or something in that struct?
let me try that...maybe I'll get a valid response.
Although, I think I'm just feeding tdom the wrong thing...not sure.

(Reply to this) (Thread from start) (Parent) (Thread) (Hide 10 comments) (Show 10 comments)

	Re: curioser and curioser tonybaldwin 2010-04-07 03:30 pm UTC (link)
	nope...still keep getting an error from the parser syntax error on line 1 col 0 (Reply to this) (Thread from start) (Parent) (Thread) (Hide 1 comment) (Show 1 comment)

	Re: curioser and curioser tonybaldwin 2010-04-07 03:30 pm UTC (link)
	I'm up on #tcl @freenode trying to sort this out (Reply to this) (Thread from start) (Parent)

Re: curioser and curioser

catness
2010-04-07 04:16 pm UTC (link)

No, getchallenge does NOT need username/password (that's why it's secure ;) You can see exactly what it needs:
http://www.livejournal.com/doc/server/ljp.csp.xml-rpc.getchallenge.html

re:base64, cyrillic characters certainly require encoding, not sure about European languages, I think German characters worked without it...

(Reply to this) (Thread from start) (Parent) (Thread) (Hide 1 comment) (Show 1 comment)

	Re: curioser and curioser tonybaldwin 2010-04-07 04:24 pm UTC (link)
	well then, if ß works, ç should be fine. Content-Length: 97 this should basically be static, right? I don't need to fish that var out of anywhere, since, it appears the very same text/xml is sent for every challenge. (Reply to this) (Thread from start) (Parent)

	Re: curioser and curioser catness 2010-04-07 04:19 pm UTC (link)
	Can you print out the full response from the server (before parsing it)? (Reply to this) (Thread from start) (Parent) (Thread) (Expand) (Hide 5 comments) (Show 5 comments)

tonybaldwin, 2010-04-07 04:28 pm UTC (Expand)

catness, 2010-04-07 04:29 pm UTC (Expand)

tonybaldwin, 2010-04-07 04:35 pm UTC (Expand)

tonybaldwin, 2010-04-07 04:36 pm UTC (Expand)

catness, 2010-04-07 04:50 pm UTC (Expand)

no subject

tonybaldwin
2010-04-07 05:22 pm UTC (link)

I got the challenge!
I got it!

Oddly, my post still doesn't appear...
I have

<?xml version="1.0"?>
<methodCall><methodName>LJ.XMLRPC.postevent</methodName>
<params><param><value><struct>
<member><name>auth_scheme</name><value><string>c0</string></value></member>
<member><name>auth_method</name><value><string>clear</string></value></member>
<member><name>challenge</name><value><string><?xml version="1.0" encoding="UTF-8"?><methodResponse><params><param><value><struct><member><name>auth_scheme</name><value><string>c0</string></value></member><member><name>server_time</name><value><int>1270660801</int></value></member><member><name>challenge</name><value><string>c0:1270659600:1201:60:ia856BGhJT9RoL1XgxbN:edfe983180681a5ec49686501358dab6</string></value></member><member><name>expire_time</name><value><int>1270660861</int></value></member></struct></value></param></params></methodResponse></string></value></member>
etc., etc.

sending it with
set dopost [http::geturl http://www.livejournal.com/interface/xmlrpc -query $post -type "text/xml" ]

Frank says "ok"
but no post appears on my LJ...
I get no errors.

Making progress! but, something still needs work, obviously...
off to NYC now...
back later

(Reply to this) (Thread) (Hide 1 comment) (Show 1 comment)

	no subject catness 2010-04-07 05:37 pm UTC (link)
	Yay! Probably you're not creating the response correctly - it's not just sending the challenge back to the server, it's creating an md5 hash with it and password. (Reply to this) (Thread from start) (Parent)

no subject

catness
2010-04-07 06:55 pm UTC (link)

Meanwhile, I dunno about the challenge but I've succeeded to post with cleartext password just fine, with the following script (though it's my first attempt on using tcl so I don't really know what I'm doing, lol). You can see the result at http://catness.insanejournal.com/204215.html
(the server returns the url among the result data)

#!/usr/bin/tclsh

package require http;

set url "http://www.insanejournal.com/interface/xmlrpc"

set password "MYPASSWORD"
set username "catness"

set post "<?xml version=\"1.0\"?>
<methodCall>
<methodName>LJ.XMLRPC.postevent</methodName>
<params>
<param>
<value><struct>
<member>
<name>day</name>
<value><int>7</int></value>
</member>
<member>
<name>event</name>
<value><string>This is a test. Please ignore.</string></value>
</member>
<member>
<name>hour</name>
<value><int>21</int></value>
</member>
<member>
<name>lineendings</name>
<value><string>unix</string></value>
</member>
<member>
<name>min</name>
<value><int>40</int></value>
</member>
<member>
<name>mon</name>
<value><int>4</int></value>
</member>
<member>
<name>props</name>
<value><struct>
<member>
<name>current_mood</name>
<value><string>awake</string></value>
</member>
<member>
<name>current_moodid</name>
<value><int>87</int></value>
</member>
<member>
<name>taglist</name>
<value><string>test</string></value>
</member>
<member>
<name>useragent</name>
<value><string>tcl</string></value>
</member>
</struct></value>
</member>
<member>
<name>security</name>
<value><string>public</string></value>
</member>
<member>
<name>subject</name>
<value><string>test, please ignore</string></value>
</member>
<member>
<name>username</name>
<value><string>$username</string></value>
</member>
<member>
<name>password</name>
<value><string>$password</string></value>
</member>
<member>
<name>ver</name>
<value><int>1</int></value>
</member>
<member>
<name>year</name>
<value><int>2010</int></value>
</member>
</struct></value>
</param>
</params>
</methodCall>"

puts $post

puts $url

set post_response [http::geturl $url -query $post -type "text/xml" ]

puts [http::data $post_response]

(Reply to this) (Thread) (Hide 1 comment) (Show 1 comment)

no subject

tonybaldwin
2010-04-09 11:20 pm UTC (link)

Hmmm...
i'm getting this in the http::data response:
"Can't call method "is_validated" on an undefined value at /home/lj/cgi-bin/Apache/Livejournal.pm line 1814"

wonder what I'm still doing wrong...or why LJ is being a b1+ch when IJ works, or something...(I haven't tried IJ, but I'm doing nearly precisely what you did with IJ, only to LJ, with no joy)...

(Reply to this) (Thread from start) (Parent)

no subject

catness
2010-04-07 08:26 pm UTC (link)

And I fixed the challenge too (got curious - damn you ;) Here's the code which creates $response from $challenge and $password - note the "tolower" bit, cost me a couple of hours, doesn't work without it... all the rest is the same as in the previous example, except for using auth_challenge and auth_response, of course. The whole script is too long to post because it's using some xml processing function which I've found elsewhere, but I can send it if you need.

set encoded [string tolower [md5::md5 -hex $password] ]
set cat $challenge$encoded
set response [string tolower [md5::md5 -hex $cat] ]

This post starts to be difficult to navigate... ;)

(Reply to this) (Thread) (Hide 9 comments) (Show 9 comments)

	success, at last! tonybaldwin 2010-04-10 01:45 am UTC (link)
	http://tonytraductor.livejournal.com/291471.html I DID IT!!! FINALLY!!! (Reply to this) (Thread from start) (Parent) (Thread) (Hide 8 comments) (Show 8 comments)

Re: success, at last!

tonybaldwin
2010-04-10 02:17 am UTC (link)

this worked:

################
# post to livejournal...

proc ljpost {} {

# changing html tags for insertion in xml
set content [.txt.txt get 1.0 end]
set escaped [string map {
"<" "<"
">" ">"
\" "\""
} $content]
.txt.txt delete 1.0 end
.txt.txt insert insert $escaped
# is it redundant that ptext and escaped from the above are the same?
# probably
set ptext [.txt.txt get 1.0 {end -1c}]

global mypost
set mypost "<?xml version=\"1.0\"?>
<methodCall><methodName>LJ.XMLRPC.postevent</methodName>
<params><param>
<value><struct>
<member><name>year</name><value><int>$::year</int></value></member>
<member><name>mon</name><value><int>$::mon</int></value></member>
<member><name>day</name><value><int>$::day</int></value></member>
<member><name>hour</name><value><int>$::hour</int></value></member>
<member><name>min</name><value><int>$::min</int></value></member>
<member><name>usejournal</name><value><string>$::usej</string></value></member>
<member><name>event</name><value><string>$ptext</string></value></member>
<member><name>username</name><value><string>$::ljname</string></value></member>
<member><name>password</name><value><string>$::ljpswd</string></value></member>
<member><name>subject</name><value><string>$::subject</string></value></member>
<member><name>lineendings</name><value><string>unix</string></value></member>
<member><name>security</name><value><string>$::priv</string></value></member>
<member><name>ver</name><value><int>1</int></value></member>
<member><name>props</name>
<value><struct>
<member><name>useragent</name><value><string>Xpostulate</string></value></member>
<member><name>current_location</name><value><string>$::loc</string></value></member>
<member><name>current_mood</name><value><string>$::mood</string></value></member>
<member><name>taglist</name><value><string>$::tags</string></value></member>
<member><name>current_music</name><value><string>$::tunes</string></value></member>
</struct></value></member>
</struct></value>
</param></params>
</methodCall>"

global plength
set plength [string length $mypost]

set dopost [http::geturl http://www.livejournal.com/interface/xmlrpc -query $::mypost -type "text/xml" ]
set ljmta [http::meta $dopost]
set ljstat [http::status $dopost]
set ljresponse [http::data $dopost]
# upvar #0 $dopost state
# puts $state(body)

toplevel .rsp
wm title .rsp "Post Status"

frame .rsp.btns
grid [tk::label .rsp.btns.lbl -text "Frank says: $ljstat\nPost length: $::plength"]
grid [tk::button .rsp.btns.view -text "View Journal" -command {
set ljv "http://$::usej.livejournal.com"
exec $::brow $ljv &
}]\
[tk::button .rsp.btns.ok -text "DONE" -command {destroy .rsp}]

frame .rsp.txt
text .rsp.txt.t -width 80 -height 20
.rsp.txt.t insert end $ljresponse

pack .rsp.btns -in .rsp -side top -fill x
pack .rsp.txt.t -in .rsp.txt -side top -fill x
pack .rsp.txt -in .rsp -side top -fill x

}

It seems to be working on LJ, IJ, and DW.
Iziblog apparently doesn't play with xmlrpc (but flatposting works fine there), and, I don't have a deadjournal to test that.

Now, I just have to look at the difference between lj.xmlrpc and wordpress, and I'll have wordpress posting working!
The google api for blogger can't be too far a stretch, either...

(Reply to this) (Thread from start) (Parent)

Re: success, at last!

catness
2010-04-10 05:01 am UTC (link)

Wh00t!!!! :D :D

I suggest you should add challenge/response at some stage - sending password in clear text over an unencrypted connection makes a lot of people twitchy.

Also if you want more LJ-clones for testing, I've been using http://www.inksome.com and http://www.scribbld.net/ . (I used to have DJ but deleted it; as far as I remember, it did work with XML-RPC)

(Reply to this) (Thread from start) (Parent) (Thread) (Expand) (Hide 6 comments) (Show 6 comments)

tonybaldwin, 2010-04-10 06:30 am UTC (Expand)

tonybaldwin, 2010-04-10 07:05 am UTC (Expand)

catness, 2010-04-10 07:17 am UTC (Expand)

catness, 2010-04-10 09:34 am UTC (Expand)

tonybaldwin, 2010-04-10 04:20 pm UTC (Expand)