Sitemaps on multiple front end servers using a http handler, is that a good idea?

Posted by Rihan Meij on Stack Overflow See other posts from Stack Overflow or by Rihan Meij
Published on 2010-03-30T09:08:23Z Indexed on 2010/03/30 9:13 UTC
Read the original article Hit count: 512

Filed under:

sitemaps

|

httphandler

|

best

|

best-practices

|

seo

Question 1

We would like to generate a site map for our CMS site

We have multiple front end servers with approx a million articles.

Environment

multiple MS SQL servers
multiple front end servers (load balanced)
ASP.net - and IIS 6
Windows 2003

To have the site maps (the site map index file, and the site map files) physically on the front end servers will be a operations nightmare and error prone.

So we are considering using http handlers instead so that it does not matter what server gets the request, it will be able to serve the correct xml file.

Question 2

If we ping Google each time we publish a new article will that effect us negatively if that happens more than once a hour.

Thanks!

© Stack Overflow or respective owner

Related posts about sitemaps

.XML Sitemaps and HTML Sitemaps Clarification

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I've got a website with about 170 pages and I want to create an effective Sitemap for it as it is long due. The website is internally linked very well but I still want to take advantage of creating a sitemap to allow SE's to crawl my site easier and to hopefully increase my websites PR. Though I am… >>> More
Learning the Difference Between XML and HTML Sitemaps

as seen on Ezine Articles - Search for 'Ezine Articles'
There are many differences to XML and HTML sitemaps. Find out those difference, and why you should have both for your site. >>> More
How to efficiently serve massive sitemaps in django

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a site with about 150K pages in its sitemap. I'm using the sitemap index generator to make the sitemaps, but really, I need a way of caching it, because building the 150 sitemaps of 1,000 links each is brutal on my server.[1] I COULD cache each of these sitemap pages with memcached, which… >>> More
Website Sitemaps and <priority>, is it working?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, My "Privacy Policy" page is seen more important by Google than other really more important pages on my website. I'm currently creating a script to generate a sitemap, should I bother with the priority? How do you effectively assign priorities to pages? I consider one of my page important but… >>> More
Caching sitemaps in django

as seen on Stack Overflow - Search for 'Stack Overflow'
I implemented a simple sitemap class using django's default sitemap app. As it was taking a long time to execute, I added manual caching: class ShortReviewsSitemap(Sitemap): changefreq = "hourly" priority = 0.7 def items(self): # try to retrieve from cache result = get_cache(CACHE_SITEMAP_SHORT_REVIEWS… >>> More

Related posts about httphandler

How to POST data to ASP.NET HttpHandler?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am trying to send a large chunk of data over to a HTTP handler. I can't send it using GET because of the URL length limit so I decided to POST it instead. The problem is that I can't get at the values. context.Request.Form shows that it has 0 items. So is there a way that I can POST data to… >>> More
HttpHandler instance and HttpApplication object - does the latter...?

as seen on Stack Overflow - Search for 'Stack Overflow'
A Book showed an example where ( when using IIS7 ) the following module was configured such that it would be used by any web application ( even by non-asp.net apps ) running on a web site. But: A) if this module is invoked for non-asp.net application, then how or why would HttpApplication object… >>> More
Custom HTTPHandler causing caching or session issues?

as seen on Stack Overflow - Search for 'Stack Overflow'
So i have a custom CMS running under .Net 3.5 written entirely in c#. The engine is optimized to render for mobile devices, but also server to normal web browsers. It also supports cookieless sessions. Great... I've chosen not to cache anything (including browser data) in order to control the rendering… >>> More
Caching the xml response from a HttpHandler

as seen on Stack Overflow - Search for 'Stack Overflow'
My HttpHandler looks like: public void ProcessRequest(HttpContext context) { context.Response.ContentType = "text/xml"; XmlWriter writer = new XmlTextWriter(context.Response.OutputStream, Encoding.UTF8); writer.WriteStartDocument(); writer.WriteStartElement("ProductFeed"); … >>> More
Server side caching doesn't work with HttpHandler

as seen on Stack Overflow - Search for 'Stack Overflow'
If we use an aspx page with a Caching Profile, the server caches images that are loaded with the aspx page. So if ten clients load the same image through the aspx page (same url), for one client the image is gotten out of the db, for the nine others it is cached. When we use a HttpHandler, this doesn't… >>> More