how to prevent all crawlers except good ones (google, bing, yahoo) access website content?

Posted by tranhuyhung on Stack Overflow See other posts from Stack Overflow or by tranhuyhung
Published on 2010-03-09T14:53:49Z Indexed on 2010/04/30 0:47 UTC
Read the original article Hit count: 245

Filed under:
|

I just want to let Google, Bing, Yahoo crawl my website to build indexes. But I do not want my opposite website use crawling service to steal my website content. What should I do?

© Stack Overflow or respective owner

Related posts about crawler

Related posts about prevention