GoFuckYourself.com - Adult Webmaster Forum - View Single Post

rowan · 03-07-2008, 06:08 PM

BTW I've also caught some people using scripted fetches, they were up to about 100,000 by the time I blocked them. Probably querying multiple proxy sites so they don't get blocked by the site they're scraping. (In this case it was Google)

03-07-2008, 06:08 PM
rowan Too lazy to set a custom title Join Date: Mar 2002 Location: Australia Posts: 17,393	BTW I've also caught some people using scripted fetches, they were up to about 100,000 by the time I blocked them. Probably querying multiple proxy sites so they don't get blocked by the site they're scraping. (In this case it was Google)