--- Log opened Sat Aug 06 00:00:30 2011
00:27 < conseo> mcallan: have you used xpath for scraping_
00:27 < conseo> ?
00:28 < conseo> could you expose the pollname (with a link on the difference bridge?) i could then scrape without database access to a voteserver object
00:28 < conseo> i kind of like that idea
00:29 < conseo> it would allow to crawl data for different difference bridges (and therefore pollservers, right?)
00:30 < conseo> i go to bed, cu tomorrow hopefully :-)
00:45 < mcallan> goodnight c, cu tomorrow.  there may be problems with xf theatre being cross-server, and we'd probably need a good reason before going into that complexity
00:51 < mcallan> we'll eventually (when another project joins us) need limited  cross-server stuff within a single cluster of servers around a pollwiki.  if another project needed access to dbridge data, i'd expose a web api
00:55 < mcallan> come to think of it, we already have a web api for the dbridge: http://zelea.com/project/votorola/_/javadoc/votorola/a/diff/DiffCacheSS.html
01:02 < mcallan> hmmm, it doesn't actually tell you the user names, just the mnemonics and draft URLs (which might be remote). e.g.: http://zelea.com:8080/v/oDiffCache?d=4048.2722-4044.2721&pairData&form=json&pretty
12:34 < conseo> mcallan: the mailish usernames are on the bridge itself: http://u.zelea.com:8080/v/w/D?b=4268&a=4203&aR=2885&bR=2854
12:42 < conseo> but not exposed in oDiffCache JSON
12:42 < conseo> i only need the pollname for PollJig to work
14:24 < mcallan> ah, i forgot about the feed jigs.  if we deploy bite feeds separate from the vote-server, then all jig biters have to be written to use web apis instead of the local database.  i think my point stands, we don't want that complexity right now
14:27 < mcallan> also i wouldn't scrape from the server's web ui (like WP_D) when there's a more efficient web api to use (just as i wouldn't use the web api when there's a more efficient java api)
14:28 < mcallan> (not only more efficient, but simpler and easier)
14:39 < mcallan> right, oDiffCache doesn't give the pollname currently (not sure why i was talking about user names)
--- Log closed Sun Aug 07 00:00:46 2011