Why can't GoogleBot forget a 404 File Does Not Exist?

Posted by Sam on Pro Webmasters See other posts from Pro Webmasters or by Sam
Published on 2011-03-05T01:34:43Z Indexed on 2011/03/05 7:32 UTC
Read the original article Hit count: 333

Filed under:
|
|
|

Hi folks,

For two months now, googlebot is trying to get a file which does not exist anymore. This is just one example out of many: I had renamed the file to a better name and removed the old file. Now, why does Google insist on getting a file which it already has seen does not exist for months? doesn't it just give up and get on being a happy bot?

My Error log file is filled with these repeating lines all wanting to get that one file, although they know for already long time that its not there:

  1. What to do in these situations?
  2. Are there automatic redirection rules that handle via 301 to the home page?

    [Sat Mar 05 01:55:41 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php

    [Sat Mar 05 01:58:20 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php

    [Sat Mar 05 02:03:57 2011] [error] [client 66.249.66.177] File does not exist: /var/www/vhosts/website.org/httpdocs/extraNeus.php

on and on ... and on...

© Pro Webmasters or respective owner

Related posts about google

Related posts about redirects