Why is Google Webmaster Tools crawling invalid URLS and showing 500 errors?

Posted by Amos Kane on Pro Webmasters See other posts from Pro Webmasters or by Amos Kane
Published on 2012-04-06T21:23:53Z Indexed on 2012/04/06 23:40 UTC
Read the original article Hit count: 329

Filed under:

google-webmaster-tools

Google Webmaster tools is reporting 12k+ 500 errors. Eeek!

None of the URLS are valid- they all contain www.youtube.com. First, why is Google crawling these URLS if they don't exist? I supplied a sitemap, and they are of course not in the sitemap.

I don't have a robots.txt blocking anything. I've checked for invalid redirects--none, and checked for unclosed tags or something that would throw www.youtube.com into the URL by accident--none.

In every 'linked from', the referring URL is also a bad URL, with www.youtube.com in it. The Google Tools report no malware, and I can't check the server logs because the host won't give me access.

Really stuck!! Any ideas appreciated!

Related posts about google-webmaster-tools

Weird entry for robots.txt on a Naked Domain in Google Webmaster Tools

as seen on Pro Webmasters - Search for 'Pro Webmasters'
We own a .co.uk address and use an Internet hosting company that has made mistakes around DNS in the past. Our main site is hosted on www. and their reluctance to allow editing of AAAA records on-line means our naked domain does not resolve. Currently when we attempt to reach the naked version there… >>> More
How to submit sitemap when your website has partial https? - Error: "Not in Domain"

as seen on Pro Webmasters - Search for 'Pro Webmasters'
My website is an ecommerce that is set up to do http for the item browsing portion, but https for things like shopping cart, contact us, etc.. (anything that has forms on it). I've submitted my website a long time ago to google webmaster tools as http://www.mywebsite.com. I also submitted a sitemap… >>> More
Why Use Google Webmaster Tools

as seen on Ezine Articles - Search for 'Ezine Articles'
This article talks about why Google Webmaster Tools is an amazing program for optimizing and debugging your website. It provides many advantages for any website owner who uses it. >>> More
What Are Soft 404s in Google Webmaster Tools

as seen on Ezine Articles - Search for 'Ezine Articles'
There are two types of 404 response codes when a web page cannot be found. Google Webmaster Tools now displays both types. Find out why you do not want to have any soft 404 errors. >>> More
Revamped Google Webmaster Tools

as seen on Get blogged by JoKi - Search for 'Get blogged by JoKi'
With a positive surprise I realized today that Google's Webmaster Tools had some minor overhauling and provide some more details than before. Most obvious are the changes on the dashboard where the Top Search Queries now provide information about impressions and clicktroughs instead of the rankings… >>> More

Developer IT