Multiple SiteMap: entries in robots.txt?

Posted by user306942 on Stack Overflow See other posts from Stack Overflow or by user306942
Published on 2010-04-07T16:31:58Z Indexed on 2010/04/07 16:43 UTC
Read the original article Hit count: 266

Filed under:
|

I have been searching around using Google but I can't find an answer to this question.

A robots.txt file can contain the following line:

Sitemap: http://www.mysite.com/sitemapindex.xml

but is it possible to specify MULTIPLE sitemap index files in the robots.txt and have the search engines recognize that and crawl ALL of the sitemaps referenced in each sitemap index file? For example, will this work:

Sitemap: http://www.mysite.com/sitemapindex1.xml

Sitemap: http://www.mysite.com/sitemapindex2.xml

Sitemap: http://www.mysite.com/sitemapindex3.xml

© Stack Overflow or respective owner

Related posts about sitemap

Related posts about robots.txt