Python Scraper for Javascript?

Posted by Diego on Stack Overflow See other posts from Stack Overflow or by Diego
Published on 2010-05-28T02:38:00Z Indexed on 2010/05/28 2:41 UTC
Read the original article Hit count: 276

Hey all,

Can anyone direct me to a good Python screen scraping library for javascript code (hopefully one with good documentation/tutorials)? I'd like to see what options are out there, but most of all the easiest to learn with fastest results... wondering if anyone had experience. I've heard some stuff about spidermonkey, but maybe there are better ones out there?

Specifically, I use BeautifulSoup and Mechanize to get to here, but need a way to open the javascript popup, submit data, and download/parse the results in the javascript popup.

<a href="javascript:openFindItem(12510109)" onclick="s_objectID=&quot;javascript:openFindItem(12510109)_1&quot;;return this.s_oc?this.s_oc(e):true">Find Item</a>

I'd like to implement this with Google App engine and Django. Thanks!

© Stack Overflow or respective owner

Related posts about JavaScript

Related posts about python