Search Results

Search found 287 results on 12 pages for 'crawling pasta hellion'.

Page 2/12 | < Previous Page | 1 2 3 4 5 6 7 8 9 10 11 12  | Next Page >

• 404s on password protected content

  - by tjb1982

  I'm new to WordPress and SEO, generally, but we've been running into problems with our site that don't seem to make sense to me. The problem is that our editor likes to schedule posts and/or mark them private until she is ready to make them public, but somehow Google is crawling these posts and getting 404s (because they are password protected).…

  Read the article

• SharePoint Server Search Not Crawling

  - by tekiegreg

  Hi there, we recently moved some sites into a new farm, everything seems to be doing fine, but the search for reasons I can't identify are not crawling the migrated content. We're getting this message in our crawl log for every document: http://xxx/sites/...announcements The object was not found. (The item was deleted because it was either not…

  Read the article

• Massive Crawling requests from Google Apps Engine useragent

  - by SilentPlayer

  Hi friends, I'm badly affected with 'Google AppEngine-Google' UserAgent.. receiving 5/6 requests per second on http server. This bot is crawling my site just like GoogleBot does. Following is the sample of url in my access logs. 72.14.192.3 - - [19/May/2010:01:27:06 +0000] "GET /some-url/etc-123.htm HTTP/1.1" 200 4707 "-" "AppEngine-Google;…

  Read the article

• Ping and crawling not working, site still resolving

  - by Andrew Alexander

  Ok, so we're trying to figure out why the site of one of our clients isn't being crawled by Google (we've ruled out robots.txt or meta tags) When we go to the site, either IP address or domain name, the site resolves, everything works. However, Google is getting a 302 redirect (which it apparently isn't following for crawling), and when we…

  Read the article

• Need to sanity-check my .htaccess, especially Limit GET POST line for Google repellent

  - by jose

  I need a sanity check on this .htaccess (from a WordPress site) I inherited from a 5 month+ old site. What's the symptom? Google + Bing crawl, but don't index any of the pages. Let me be clear: I'm not mad about "not ranking high." I think something is (accidentally) rejecting search engine indexing. I am not an expert on .htaccess, but one…

  Read the article

• Ajax site not being crawled - have escaped fragment, what's wrong? [closed]

  - by Harry

  My site is anonkun.com. You can see that it's "ajax" and doesn't load much HTML. Here are some example pages: http://anonkun.com http://anonkun.com/?_escaped_fragment_= http://anonkun.com/stories/Dev-kun---FAQ/6ef881f8-cf48-4f87-a688-c585f23809c5…

  Read the article

• How to interpret number of URL errors in Google webmaster tools

  - by user359650

  Recently Google has made some changes to Webmaster tools which are explained below: http://googlewebmastercentral.blogspot.com/2012/03/crawl-errors-next-generation.html One thing I could not find out is how to interpret the number of errors over time.…

  Read the article

• Extremely large spike in traffic on the 1st - 4th of every month from mobile browsers

  - by wsanville

  I've noticed that on the 1st - 4th of the recent months (since January), several sites I maintain are getting thousands of requests from mobile browsers, whereas throughout the rest of the month, the numbers are in the single or double digits. Has…

  Read the article

• adding tagged / dynamic pages in sitemap

  - by sam

  ive got a blog thats been running for about a year ive made about 200 posts, and there should be about 220 pages to index (additional pages for about / contact ect). When i go to crawl the site i get 1900 pages because of all the pages that are…

  Read the article

• What measures can be taken to increase Google indexing speed for a given newly created page?

  - by knorv

  Consider a website with a large number of pages. New pages are published regularly. When publishing a new page the website operator wants to get the newly created paged indexed in Google as soon as possible. The website operator wants to…

  Read the article

• why my website doesn't ranked by alexa? [closed]

  - by arshen

  i created a website with WordPress and post 10+ article in period of two month, but alexa doesn't rank my website. i tried to change my theme, URL and other related things and submit my website URL manually to alexa dashboard, while i…

  Read the article

• How to crawl a webPage with dynamic content added by javascript

  - by blunderboy

  I guess there is a news that Google bots have the capability to understand our javascript code. It means this is possible to fully crawl a webpage which has lazy loading feature enabled. I am using Apache Nutch to crawl websites but I…

  Read the article

• Is this Anti-Scraping technique viable with Crawl-Delay?

  - by skibulk

  I want to prevent web scrapers from abusing 1,000,000 on my website. I'd like to do this by returning a "503 Service Unavailable" error code for users that access an abnormal number of pages per minute. I don't want search engine…

  Read the article

• Will google "forget" unlinked pages?

  - by Mystere Man

  If i remove all links to a page, but do not delete the page from the site (nor block it from being requested), will google eventually "forget" about it when it reindexes the site? Assuming of course there are no other links to…

  Read the article

• What measures can be taken to make sure Google is aware of the existence of a newly created page?

  - by knorv

  Consider a website with a large number of pages. New pages are published regularly. When publishing a new page the website operator wants to get the newly created paged indexed in Google as soon as possible. The website…

  Read the article

• Using Ajax #! for Google but site is not being crawled any more

  - by user28231

  We used to have all links in a normal way (thus with parameters?), we changed to Ajax loading cause we installed a music player. Here's an example: Old links: http://stereofox.com/post.php?idPost=5326 New links:…

  Read the article

• search engine crawling frequency

  - by Aditya Pratap Singh

  I want to design a search engine for news websites ie. download various article pages from these websites, index the pages, and answer search queries on the index. I want a short pseudocode to find an…

  Read the article

• guide on crawling the entire web ?

  - by bohohasdhfasdf

  i just had this thought, and was wondering if it's possible to crawl the entire web (just like the big boys!) on a single dedicated server (like Core2Duo, 8gig ram, 750gb disk 100mbps) . I've come…

  Read the article

• wget crawling search results of news website

  - by kiltek

  I am trying to crawl the search results of a news website using wget. The name of the website is www.voanews.com. After typing in my search keyword and clicking search, it proceeds to the…

  Read the article

• Crawling engine architecture - Java/ Perl integration

  - by Bigtwinz

  Hi all, I am looking to develop a management and administration solution around our webcrawling perl scripts. Basically, right now our scripts are saved in SVN and are manually kicked off…

  Read the article

• Oracle Secure Enterprise Search(SES) Intranet crawling problem.

  - by vipin k.

  I am using oracle Oracle Secure Enterprise Search(SES), and using the crawler to crawl the Intranet site. but i am getting the error. EQG-30008: http://site-name/: Not found I have added…

  Read the article

• Web Crawling Sites with Javascripts or web forms

  - by Jojo

  Hello everyone, I have a webcrawler application. It successfully crawled most common and simple sites. Now i ran into some types of websites wherein HTML documents are dynamically…

  Read the article

• Asynchronous crawling F#

  - by jlezard

  When crawling on webpages I need to be careful as to not make too many requests to the same domain, for example I want to put 1 s between requests. From what I understand it is…

  Read the article

• Not crawling the same content twice

  - by sirrocco

  I'm building a small application that will crawl sites where the content is growing (like on stackoverflow) the difference is that the content once created is rarely modified. …

  Read the article

• Where Googlebot starts crawling?

  - by Nirmal

  Say if I register a domain and have developed it into a complete website. From where and how Googlebot knows that the new domain is up? Does it always start with the domain…

  Read the article

< Previous Page | 1 2 3 4 5 6 7 8 9 10 11 12  | Next Page >