GoFuckYourself.com - Adult Webmaster Forum - View Single Post - .htaccess IP banning script

mkx · 10-13-2010, 11:22 AM

I am looking to protect my websites data and images against spiders, bots, data extraction etc. I figure this can be done by limiting the number of requests and/or data transfer an IP can make in a certain amount of time. I do not however want to block google or other major search engines from spidering my site which I guess makes things more complicated. Does anyone know of any such script or method?

10-13-2010, 11:22 AM
mkx Confirmed User Industry Role: Join Date: Nov 2003 Location: Toronto Posts: 4,001	.htaccess IP banning script - bans robots, spiders, etc I am looking to protect my websites data and images against spiders, bots, data extraction etc. I figure this can be done by limiting the number of requests and/or data transfer an IP can make in a certain amount of time. I do not however want to block google or other major search engines from spidering my site which I guess makes things more complicated. Does anyone know of any such script or method?