Search Results

Search found 2 results on 1 pages for 'webspiders'.

Page 1/1 | 1 

• Problem with web spiders

  - by gautam

  Hello, could you help me code web spider that crawls say the links that start with www.example.com/ruby/ and not the entire website www.example.com

  Read the article

• SEO Problem for new dictionary site, google hasn't indexed content.

  - by John

  I loaded about 15,000 pages, letters A & B of a dictionary and submitted to google a text site map. I'm using google's search with advertisement as the planned mechanism to go through my site. Google's webmaster accepted the site mapps as good but then did not index. My index page has been indexed by google and at this point have not linked to any pages. So to get google's search to work I need to get all my content indexed. It appears google will not just index from the site map and so I was thinking of adding pages that spider in links from the main index page. But I don't want to create a bunch of pages that programicly link all of the pages without knowing if this has a chance to work. Eventually I plan on having about 150,000 pages each page being a word or phrase being defined. I wrote a program that is pulling this from a dictionary database. I would like to prove the content that I have to anyone interested to show the value of the dictionary in releation to the dictionary software that I'm completing. Suggestions for getting the entire site indexed by google so I can appear in the search results? Thanks

  Read the article

1