Can YQL parse web sites requiring cookie-based authentication?
- by user249488
First, my use case:
I'm trying to use YQL's built in XPATH capabilities to scrape content from Yahoo! Fantasy Sports. It uses some sort of cookie-based authentication scheme. Basically, the sequence is:
1) Do an HTTP GET on the Yahoo! Login page
2) Parse the hidden inputs from the response and do an HTTP PUT with your Yahoo! Login on the form URL…