Why can't GoogleBot forget a 404 File Does Not Exist?
Posted
by
Sam
on Pro Webmasters
See other posts from Pro Webmasters
or by Sam
Published on 2011-03-05T01:34:43Z
Indexed on
2011/03/05
7:32 UTC
Read the original article
Hit count: 333
Hi folks,
For two months now, googlebot is trying to get a file which does not exist anymore. This is just one example out of many: I had renamed the file to a better name and removed the old file. Now, why does Google insist on getting a file which it already has seen does not exist for months? doesn't it just give up and get on being a happy bot?
My Error log file is filled with these repeating lines all wanting to get that one file, although they know for already long time that its not there:
- What to do in these situations?
Are there automatic redirection rules that handle via 301 to the home page?
[Sat Mar 05 01:55:41 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php
[Sat Mar 05 01:58:20 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php
[Sat Mar 05 02:03:57 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php
on and on ... and on...
© Pro Webmasters or respective owner