How to block this URL pattern in Varnish VCL?
Posted
by
iTech
on Server Fault
See other posts from Server Fault
or by iTech
Published on 2012-10-27T14:06:00Z
Indexed on
2012/10/27
17:03 UTC
Read the original article
Hit count: 207
My website is getting badly hit by spambots and scrappers, I am using Cloudflare but the problem still remains there. The problem is spambots accessing non-existing urls causing a lot of load to my drupal backend which goes all the way and bootstraps db just to serve a 404 error doc.
I cant simply dish out non-drupal 404's for all page not found errors, as I need to have drupal catch them. Since, varnish is in front it can check if the bot is acting nice and asking for valid url - if not it servers them a 404 or 403. These bots are causing errors using this pattern :
Now, pls. suggest a regex varnbisg VCL directive which catches this URL pattern and serves a 404 error from varnish, preventing it from reaching apache/drupal ?
© Server Fault or respective owner