Scraping a page from a secure URL which is possibly using a session ID
- by VN44CA
How to scrape a page like this.
https://www.procom.ca/JobList.aspx?keywords=&Cities=&reference=&JobType=0
It is secure, and requires a referrer? I can't get anything using wget or httplib2.
If you go through this page, you get a list and it works on a browser but not the command line.
https://www.procom.ca/jobsearch.aspx
I am interested in command line fetching.
thx