How can I set up a load balancer to direct all Search Engine Bot traffic to one server?
- by Ryan
We have a simple load balancer set up on Rackspace to 3 web server nodes. After reviewing our traffic and expenses, the largest bandwidth hog is Google Bot. Since on Rackspace we pay for bandwidth by the byte, we'd like to direct all traffic from GoogleBot to another host (MediaTemple) with unlimited bandwidth.
We think this would cut our hosting bill several thousand dollars a month.
Is this possible? Advisable?