Multiple SiteMap: entries in robots.txt?
Posted
by user306942
on Stack Overflow
See other posts from Stack Overflow
or by user306942
Published on 2010-04-07T16:31:58Z
Indexed on
2010/04/07
16:43 UTC
Read the original article
Hit count: 266
sitemap
|robots.txt
I have been searching around using Google but I can't find an answer to this question.
A robots.txt file can contain the following line:
Sitemap: http://www.mysite.com/sitemapindex.xml
but is it possible to specify MULTIPLE sitemap index files in the robots.txt and have the search engines recognize that and crawl ALL of the sitemaps referenced in each sitemap index file? For example, will this work:
Sitemap: http://www.mysite.com/sitemapindex1.xml
© Stack Overflow or respective owner