illegitimate traffic from user agent Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)

Posted by user114293 on Server Fault See other posts from Server Fault or by user114293
Published on 2012-03-16T09:47:10Z Indexed on 2012/03/19 18:07 UTC
Read the original article Hit count: 318

Filed under:
|
|
|

Since the beginning of the year, I'm getting a lot of traffic with the user agent Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729).

My access logs show 40% - 60% from that user agent. That's strange because the user agent states a Firefox 3.0.10 browser (is anybody using that browser in 2012? Definitely not 40%-60% of visitors on a normal website).

Also, the logs show that this user agent only requested the HTML document and no referenced assets like images, css, js files.

I checked the IPs of those requests (with that UA). It's coming from all over the world. I recognized that those IPs sometimes have a mobile user agent.

So my suspicion is a mobile app that is doing a lot of "spider requests" - but if that would be the case than other web sites should have the same problem.

That's actually my question: Does anybody experience same/similar problems?

© Server Fault or respective owner

Related posts about website

Related posts about mobile