Getting Indexed - Search Engine Optimization Methods
Normally, search engines, notably Google, Yahoo or Bing employ crawlers, some times also referred as Bots, to find and index Web Pages in order to feed their search results. However, these crawlers do not index all the web pages of a website.