Search Results

Search found 27 results on 2 pages for 'webscraping'.

Page 2/2 | < Previous Page | 1 2 

• How to know if the website being scraped has changed?

  - by Lost_in_code

  I'm using PHP to scrape a website and collect some data. It's all done without using regex. I'm using php's explode() method to find particular HTML tags instead. It is possible that if the structure of the website changes (CSS, HTML), then wrong data may be collected by the scraper. So the question is - how do I know if the HTML structure has changed? How to identify this before storing any data to my database to avoid wrong data being stored.

  Read the article

• Is there something in C# that lets me keep a .XML file (with its content and everything) in memory,

  - by Sergio Tapia

  I'm going to be doing some webscraping and my plan is to have something like this: public class Searcher { public void Search(string searchTerm) { } private void Search(string term) { //Some HTMLAgilityPack Voodoo here } private void SaveResults() { //Actually save the results as .XML file. } } Thanks!

  Read the article

< Previous Page | 1 2