GoFuckYourself.com - Adult Webmaster Forum - .htaccess IP banning script

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)

- Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)

- - .htaccess IP banning script - bans robots, spiders, etc (https://gfy.com/showthread.php?t=992288)

mkx	10-13-2010 11:22 AM

.htaccess IP banning script - bans robots, spiders, etc

I am looking to protect my websites data and images against spiders, bots, data extraction etc. I figure this can be done by limiting the number of requests and/or data transfer an IP can make in a certain amount of time. I do not however want to block google or other major search engines from spidering my site which I guess makes things more complicated. Does anyone know of any such script or method?

Cyber Fucker

10-13-2010 11:33 AM

http://www.google.com/#hl=en&q=bad+b...ccess+ban+list

mkx	10-13-2010 11:53 AM

thanks88

urbanpimp

10-13-2010 11:54 AM

Quote:

Originally Posted by Cyber Fucker (Post 17603207)

http://www.google.com/#hl=en&q=bad+b...ccess+ban+list

thanks :thumbsup

RycEric

10-13-2010 11:55 AM

Quote:

Originally Posted by mkx (Post 17603172)

This can be superceded by using bots with proxy databases. Just an FYI.

Cyber Fucker

10-13-2010 01:37 PM

Well, I can't post links to other forums here... but if you browse the link I gave you there will be one on the 1st search results page that has plenty of htaccess configs including lists of bad bots, website scrapers etc. You're welcome.

mkx	10-13-2010 01:38 PM

i know httrack can make it look like the browser is internet explorer or firefox, would this still catch it>?

All times are GMT -7. The time now is 02:29 AM.