Web crawler that can interpret javascript

Posted by user320662 on Stack Overflow See other posts from Stack Overflow or by user320662
Published on 2010-04-19T19:11:18Z Indexed on 2010/04/19 19:13 UTC
Read the original article Hit count: 379

Filed under:
|
|

Hi, I want to write a web crawler that can interpret JavaScript. Basically its a program in Java or PHP that takes a URL as input and outputs the DOM tree which is similar to the output in Firebug HTML window. The best example is Kayak.com where you can not see the resulting DOM displayed on the browser when you 'view source' but can save the resulting HTML though firebug.

© Stack Overflow or respective owner

Related posts about web

Related posts about crawler