how to prevent all crawlers except good ones (google, bing, yahoo) access website content?
- by tranhuyhung
I just want to let Google, Bing, Yahoo crawl my website to build indexes. But I do not want my opposite website use crawling service to steal my website content. What should I do?