Scraping *.aspx content using Python

Posted by tomato on Stack Overflow See other posts from Stack Overflow or by tomato
Published on 2010-04-29T23:34:52Z Indexed on 2010/04/29 23:47 UTC
Read the original article Hit count: 386

Filed under:

I'm having difficulties scraping dynamically generated table in ASPX. Trying to scrape the gas prices from a site like this GasPrices. I can extract all the information in the gas price table (address, time submitted etc.), except for the actual gas price.

Is there a way I could scrape the gas prices? i.e. somehow get a text representation of it. I'm not very familiar with ASP/ASPX - but what's being generated now is not showing up in the final HTML. I'm using Python to do the scraping, but that's irrelevant unless there's a specific library...

Thanks in advance.

Scraping *.aspx content using Python

Posted by tomato on Stack Overflow See other posts from Stack Overflow or by tomato
Published on 2010-04-29T23:34:24Z Indexed on 2010/04/29 23:47 UTC
Read the original article Hit count: 386

Filed under:

ASP.NET

|

aspx

|

python

|

webscraping

I'm having difficulties scrapping dynamically generated table in ASPX. Trying to scrap the gas prices from a site like these GasPrices. I can extract all the information in the gas price table (address, time submitted etc.), except for the actual gas price.

Is there a way I could scrap the gas prices? i.e. somehow get a text representation of it. I'm not very familiar with ASP/ASPX - but what's being generated now is not showing up in the final HTML. I'm using Python to do the scrapping, but that's irrelevant unless there's a specific library...

Developer IT