suspicious crawler activity
Posted
by
ithkuil
on Pro Webmasters
See other posts from Pro Webmasters
or by ithkuil
Published on 2011-07-01T15:18:13Z
Indexed on
2011/07/01
16:31 UTC
Read the original article
Hit count: 1210
I'm noticing that I get accesses
66.249.66.198 - - [01/Jul/2011:17:13:46 +0200] "GET /img/clip.incubus.torrent.phtml HTTP/1.1" 404 143 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.198 - - [01/Jul/2011:17:13:48 +0200] "GET /img/clip.global.deejays.download.phtml HTTP/1.1" 404 143 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
that files don't exist and there is no file on my site that has this content (I hope).
Why is googlebot trying out these links?
reverse dns and whois state that 66.249.66.198 is really googlebot.
© Pro Webmasters or respective owner