methods for preventing large scale data scraping from REST api

Posted by Simon Kenyon Shepard on Server Fault See other posts from Server Fault or by Simon Kenyon Shepard
Published on 2010-06-11T10:48:02Z Indexed on 2010/06/11 10:53 UTC
Read the original article Hit count: 315

Filed under:
|

I know the immediate answer to this is going to be there is no 100% reliable method of doing this. But I'd like to create a question that details the different possibilities, the difficulty of implementing them and success rates. I would like to go from simple software ip/request speed analysis to high end sophisticated soft/hardware tools, e.g. neural networks. With a goal of predicting and preventing bogus requests and attempts to scrape the service. Many Thanks.

© Server Fault or respective owner

Related posts about firewall

Related posts about scraping