How to get rid of crawling errors due to the URL Encoded Slashes (%2F) problem in Apache

Posted by user14198 on Pro Webmasters See other posts from Pro Webmasters or by user14198
Published on 2012-12-07T12:41:08Z Indexed on 2012/12/07 17:38 UTC
Read the original article Hit count: 235

The Google web crawler has indexed a whole set of URLs with encoded slashes (%2F) for our site. I assume it has picked up the pages from our XML sitemap file. The problem is that the live pages will actually result in a failure because of the Url Encoded Slashes Problem in Apache.

Some solutions are mentioned here

We are implementing a 301 redirect scheme for all the error pages. This should make the Google bot delete the pages from the crawling errors (no more crashing pages). Does implementing the 301s require the pages to be "live"? In that case we may be forced to implement solution 1 in the article.

The problem is that solution 1 will pose a security vulnerability..

© Pro Webmasters or respective owner

Related posts about apache

Related posts about google-webmaster-tools