Recovering from an incorrectly deployed robots.txt?
- by Doug T.
We accidentally deployed a robots.txt from our development site that disallowed all crawling. This has caused traffic to dip dramatically, and google results to report:
A description for this result is not available because of this site's robots.txt – learn more.
We've since corrected the robots.txt about a 1.5 weeks ago, and you can see our…