Why deny access to website for msnbot/bingbot?

Posted by Quandary on Pro Webmasters See other posts from Pro Webmasters or by Quandary
Published on 2012-07-18T00:31:53Z Indexed on 2012/12/19 23:15 UTC
Read the original article Hit count: 442

Filed under:
|
|
|

I've seen quite a lot of tutorials that recommend you to ban user agents containing the strings libwww-perl and msnbot. I understand why one would ban libwww-perl, it's mainly if not only used for hacking and spamming.

But why are there so many sites recommending to ban msnbot/bingbot?
Since it's a search engine, even if only with a marginal market share, I would except one would want this bot to crawl one's sites.

What is it that msnbot does that makes people ban it?

© Pro Webmasters or respective owner

Related posts about seo

Related posts about robots