wget: retrieving files recursively

Posted by Shadow on Stack Overflow See other posts from Stack Overflow or by Shadow
Published on 2010-04-09T04:57:01Z Indexed on 2010/04/09 5:03 UTC
Read the original article Hit count: 183

Filed under:

When using wget with the recursive option turned on I am getting an error message when it is trying to download a file. It thinks the link is a downloadable file when in reality it should just be following it to get to the page that actually contains the files that I want.

wget -r -l 16 --accept=jpg website.com

The error message is: .... since it should be rejected. This usually occurs when the website link it is trying to fetch ends with a sql statement. The problem however doesn't occur when using the very same wget command on that link. I want to know how exactly it is trying to fetch the pages. I guess I could always take a poke around the source although I don't know how messy the project is.

© Stack Overflow or respective owner

Related posts about wget