A good web data extraction/screen scraper program?

Posted by Taylor on Stack Overflow See other posts from Stack Overflow or by Taylor
Published on 2010-02-25T13:13:49Z Indexed on 2010/04/10 22:03 UTC
Read the original article Hit count: 579

Filed under:

screen-scraping

|

data-mining

I need to capture product data from a site on a regular basis and wondered if any one knows of a good software program? I've trialed Mozenda but its a monthly subscription and pricey in the long term. Obviously something thats free would be best but I don't mind paying either. Just need a decent program thats reliable and doesn't require much programming knowledge.

© Stack Overflow or respective owner

Related posts about screen-scraping

PHP Screen Scraping Class

as seen on Bradino - Search for 'Bradino'
After some positive feedback I have decided to continue to develop the PHP Screen Scraping class. This post will server as the permanent home for the class. Download PHP Screen Scraping Class Updates 20009-07-30 Added setHeader() function >>> More
Screen scraping over SSL with .NET

as seen on Stack Overflow - Search for 'Stack Overflow'
What solutions exist for screen scraping a site over SSL for use with .NET? My use case is that I need to login to a partner website (https), navigate through a dynamic hierarchy, and download a zipped file of reports. I certainly could use other screen scrapers if there are no good viable options… >>> More
looking for alternative to Webzinc .NET , screen scraping, web automation library for .net

as seen on Stack Overflow - Search for 'Stack Overflow'
i came across this .net library http://www.webzinc.com/online/faq.aspx however, i was wondering if there was a free alternative out there ? >>> More
Screen-scraping of a secure page of any site on https:// with asp.net in C#

as seen on Stack Overflow - Search for 'Stack Overflow'
I've done site scraping of secure page of any site on http:// but when I am trying to scrap any site on https:// then i always scrape the login page not secure page. Please advice what should i do for scraping a secure page of any site on https://. >>> More
How different is mashup from screenscraping and consuming webservices

as seen on Stack Overflow - Search for 'Stack Overflow'
From what I understand, Mashup is aggregating data from separate sources and providing a single view. How different is mashup when compared to screenscraping or using webservices to get data from external sources? >>> More

Related posts about data-mining

SQLAuthority News – Links to Book On Line – Data Mining Algorithms (Analysis Services – Data Mining)

as seen on SQL Authority - Search for 'SQL Authority'
I have quite often received request for the Data Mining Algorithms details. Book Online has wonderful resources for the same. I suggest to read them here. Data Mining Algorithms (Analysis Services – Data Mining) The data mining algorithm is the mechanism that creates a data mining model. To… >>> More
Data Mining Resources

as seen on SQL Blog - Search for 'SQL Blog'
There are many different types of analyses, each one with its own pros and cons. Relational reports have a predefined structure, and end users cannot change it. They are simple to use for end users. Reports can use real-time data and snapshots of data to show the state of a report at specific points… >>> More
Integrating Data Mining into your BI Solution (Presentation)

as seen on SQLIS - Search for 'SQLIS'
I recently gave a live meeting presentation to the UK User Group on Integrating Data Mining into your BI Solution. In it I talk about and demo ways of using your data mining models inside Integration Services, Analysis Services and Reporting Services. This is the first in a series of presentations… >>> More
What data mining tools do you use?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello everyone, Besides the two well-known Open Source tools RapidMiner and Weka, are there any other good tools (either Open Source or Commercial), which you can recommend for data mining? Thanks in advance! >>> More
NEW 2-Day Instructor Led Course on Oracle Data Mining Now Available!

as seen on Oracle Blogs - Search for 'Oracle Blogs'
A NEW 2-Day Instructor Led Course on Oracle Data Mining has been developed for customers and anyone wanting to learn more about data mining, predictive analytics and knowledge discovery inside the Oracle Database. Course Objectives: Explain basic data mining concepts and… >>> More