is it possible to use a python scrapper in a website?

Posted by Tom on Stack Overflow See other posts from Stack Overflow or by Tom
Published on 2012-06-16T04:07:24Z Indexed on 2012/06/16 9:16 UTC
Read the original article Hit count: 190

I want to scrap a website and use that content in a website of my own. I am just wondering if that can be done with python 2.7, and if so how? If not, do I have to use JavaScript to scrap it? And do you have a good place to learn how to do that or good libraries for it. For those of you wondering, the website I am scrapping is legal, and they allow for this to be done.

I have searched all over but apparently nobody tries to implement these scrappers that they write. I can write a web scrapper in python just fine. Say my scrapper scraps a name from a wikipedia page (John Doe for example), how can I use that name that I get in my website?

Another update, I have found pjsrape and PhantomJS. I have only found one stack overflow post and the github examples with aren't very intuitive. If anybody has any experience or better ways to do it I would very much appreciate it

© Stack Overflow or respective owner

Related posts about web-development

Related posts about python-2.7