Receiving requests where absolute URL on page are morphed to relative URLs

Posted by Jacob on Pro Webmasters See other posts from Pro Webmasters or by Jacob
Published on 2011-03-11T00:02:54Z Indexed on 2011/03/11 0:19 UTC
Read the original article Hit count: 374

Filed under:

url

|

robots

|

plugin

|

botattack

In our web pages, we have a hyperlink with an href to an absolute URL:

https://some.other.host.com/blah.aspx?var1=val1&var2=val2

For some reason, in our logs, we see a lot of requests to URLs of this format:

http://our.site.com/https:/some.other.host.com/blah.aspx?var1=val1&var2=val2

We don't have any JavaScript that would request that URL; it only appears inside of a hyperlink. Is there some sort of known bot, browser plugin, bug, etc. that could be responsible for these requests being made?

© Pro Webmasters or respective owner

Related posts about url

mod_rewrite for clean URL doesn't convert the URL to clean URL (but it's accessible) [on hold]

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Basically what I want to do is to convert this: http://localhost/jariungu/user_caleg.php?idCaleg2014=3 into this: http://localhost/jariungu/caleg/3 I have managed to make /jariungu/caleg/3 to direct to the original URL (as in, if I open that URL, it directs me to the appropriate page). The problem… >>> More
Tip/Trick: Fix Common SEO Problems Using the URL Rewrite Extension

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
Search engine optimization (SEO) is important for any publically facing web-site. A large % of traffic to sites now comes directly from search engines, and improving your site’s search relevancy will lead to more users visiting your site from search engine queries. This can directly or… >>> More
mod_rewrite one url to another url without changing source url

as seen on Stack Overflow - Search for 'Stack Overflow'
Is it possible to do a mod_rewrite from one url to another without changing what appears in the address bar? Example: Source URL is http://domain1.com/news Target URL is http://domain2.com/news I want to render pages from http://domain2.com/news/ but have http://domain1.com/news appear in the address… >>> More
ASP.NET MVC without Url Rewriting/Pretty Url

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have hosting with IXWebHosting, but ISAPI_Rewrite is not enabled on their Windows Server. So I want to deploy my site without Url Rewriting/Pretty Url. Is it possible? Thanks in advance, Munim >>> More
Ant get task throws "get doesn't support nested resources element" error

as seen on Stack Overflow - Search for 'Stack Overflow'
The following ant xml should work according to documentation, but does not. Can anyone tell me if I'm doing something wrong. The get task should support the nested "resources" element in Ant 1.7.1 which is the version I'm using: … >>> More

Related posts about robots

Robots.txt and "Bad" Robots

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I understand robots.txt and its purpose. I have read some people saying that using a Robots.txt gives "bad" robots or robots who do not obey a robots.txt a way to access pages on your site that you do not want accessed. While I am not looking to get into a debate about that I do have a question: If… >>> More
Ignoring Robots - Or Better Yet, Counting Them Separately

as seen on Oracle Blogs - Search for 'Oracle Blogs'
It is quite common to have web sessions that are undesirable from the point of view of analytics. For example, when there are either internal or external robots that check the site's health, index it or just extract information from it. These robotic session do not behave like humans and if their… >>> More
Can search engine robots read file with permission 640?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I am on a shared web hosting linux server. I want search engine robots/spiders to be able to read the robots.txt but not any one typing www.mysite.com/robots.txt. As per the following google group post, the user specifies that by setting file permission to 640, it's possible to deny access to robots… >>> More
Robots.txt practices with .htaccess redirections (inherits)

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I have a question regarding how to write robots.txt files for many domains and subdomains with redirects in place. We have a hosting account that enacts primary and add-on domains. All of our domains and subdomains, including the primary domain, is redirected via htaccess 301s to their own subdirectories… >>> More
Asterisk in robots.txt

as seen on Stack Overflow - Search for 'Stack Overflow'
Wondering if following will work for google in robots.txt Disallow: /*.action I need to exclude all urls ending with .action. Is this correct? >>> More