Automated download of website content using ASP.net
- by Yaaqov
Using ASP.net, what methods can I use to do the following:
Open up a connection to a given URL to read HTML content
Parse the given URL for hyperlinks, and place them in an array
Loop through each hyperlink (only 1 level down), opening each one, saving the HTML contents in a table, and move to the next hyperlink until done.
If ASP.net is not up to the task, other languages or free scripts/toolkits would be acceptable.
Thanks.