Is there any advantage/disadvantage to using robots.txt to disallow access to legal pages such as terms, privacy policy, etc.?
Posted
by
CaptainCodeman
on Pro Webmasters
See other posts from Pro Webmasters
or by CaptainCodeman
Published on 2013-03-18T23:16:15Z
Indexed on
2013/11/07
22:23 UTC
Read the original article
Hit count: 253
As I understand, having repetitive content is a detriment to search engine placement.
Given that many websites that use similar or even identical "Terms and Conditions" and "Privacy Policy" pages due to similar legal wording or due to copy & pasting from the same source, would it be a good idea to disallow access to these pages via robots.txt, in order to avoid being penalized for "non-original content"?
Or, on the contrary, could the search engines identify this as circumvention and penalize the site for trying to hide content?
Or does it not matter?
© Pro Webmasters or respective owner