Using Scrapy Spider in a CGI Script or Web Framework, ie: Django
- by Israel ANY
How do I use a Python library such as Scrapy in a CGI script or even in a framework such as Django if I need to do so later?
Here is the documentation I've consulted thus far, but it doesn't seem to meet the concern I have.
http://doc.scrapy.org/topics/spiders.html
http://doc.scrapy.org/topics/webconsole.html
Critique and suggestions are welcomed!