Make Google Apps site publicly accessible while disabling crawlers with robots.txt?
Posted
by Joannes Vermorel
on Server Fault
See other posts from Server Fault
or by Joannes Vermorel
Published on 2010-01-18T17:12:16Z
Indexed on
2010/03/28
0:03 UTC
Read the original article
Hit count: 175
I would like to create a publicly accessible Google Apps site (i.e. users do not need to be authenticated to access the content) while maintaining a policy crawlers and bots exclusion with Robots.txt. Does anyone know how to do that?
© Server Fault or respective owner