What dangers await if I block non-standard, non-major-usa search engine bots from my USA only website?

Posted by Ryan on Pro Webmasters See other posts from Pro Webmasters or by Ryan
Published on 2012-12-09T13:30:01Z Indexed on 2012/12/09 17:20 UTC
Read the original article Hit count: 309

Filed under:

seo

|

search-engines

|

robots.txt

|

robots

I noticed tons of bandwidth being used by non-USA search engine bots, so I began blocking them in an effort to save bandwidth and cpu cycles for actual users and the search engines they come from (Google, Bing, Yahoo, Ask, etc.).

Other than potentially losing some international traffic (which isn't really important to us since all of our content is very USA-centric), what additional dangers should I be concerned about?

I'm using a modified version of Jeff Starr's User Agent Blocklist

© Pro Webmasters or respective owner

Related posts about seo

Do i need a full time seo employee? [closed]

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I need seo done for 1 site that's still new. It's a niche listings/ecommerce site. And i need to make a hiring decision for this - whether there's a need for a full time employee dedicated to seo or is part time or a contract sufficient? Here's some info and assumptions : 1)The site's dynamic -… >>> More
1 SEO Article Vs 5 SEO Articles?

as seen on Ezine Articles - Search for 'Ezine Articles'
You've probably clicked on this article because you think it's a interesting article but the answer seems very easy or straight forward. If you think 5 SEO articles wins or is more beneficial to your business, then your like me. >>> More
SEO Training OR SEO Outsourcing

as seen on Ezine Articles - Search for 'Ezine Articles'
There is a lot of focus on outsourcing search optimization work, but this may not always be the best option. This article looks at why SEO Training can often be a better option because it results in more unique content which is better for search engines. >>> More
Get Professional SEO Service From SEO Experts

as seen on Ezine Articles - Search for 'Ezine Articles'
SEO service is imperative to online business. Business today has gone digital. With its power to perform international promotion, almost every brand is on a bid to establish an online presence. However, it's not easy to gain online presence without proper SEO service. >>> More
The Chinese SEO in the Internet SEO Formula

as seen on Ezine Articles - Search for 'Ezine Articles'
Most ecommerce websites are designed in order to drive the Chinese internet users to the website thus delivering a good user experience that converts the users into customers. According to a statistical report on the internet development in China, conducted during the year 2009, the Chinese SEO of… >>> More

Related posts about search-engines

Your Content Can Get Visibility Through Search Engines - Part 2

as seen on Ezine Articles - Search for 'Ezine Articles'
Your content plays an important role in defining the success of your search engine marketing plan and when you talk about SEO in India, and then you will easily understand different kinds of discoveries and how to use them for your benefit. After you have understood the traditional discovery and some… >>> More
Your Content Can Get Visibility Through Search Engines - Part 1

as seen on Ezine Articles - Search for 'Ezine Articles'
Search engine marketing aims at getting higher search engine rankings for your website but for that you need to get yourself into the search engine Index first. Your content designed for your SEO activity should be accessible to millions of internet users and if your content is not found through the… >>> More
Most Popular Internet Search Engines - Four Tips to Raise Your Website's Search Engine Ranking

as seen on Ezine Articles - Search for 'Ezine Articles'
When you've got a website, one of the most important factors you need to consider is search engine rankings. If you don't have a great ranking position, you won't be easy to find. Many people will only look through the first five pages of search engine results. For that reason, your website must be… >>> More
Tip/Trick: Fix Common SEO Problems Using the URL Rewrite Extension

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
Search engine optimization (SEO) is important for any publically facing web-site. A large % of traffic to sites now comes directly from search engines, and improving your site’s search relevancy will lead to more users visiting your site from search engine queries. This can directly or… >>> More
How Does WordPress Blog Search Engines?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, If you go to wordpress admin-settings-privacy, there are two options asking you whether you want to allow your blog to be searched though by seach engines and this option: I would like to block search engines, but allow normal visitors How does wordpress actually block search bots/crawlers… >>> More