View Single Post
Old 04-15-2013, 10:20 AM  
SplatterMaster
Confirmed User
 
SplatterMaster's Avatar
 
Industry Role:
Join Date: Jan 2012
Location: cyberspace
Posts: 790
Quote:
Originally Posted by H-Tom View Post
This .htaccess trick doesnt work on Website Ripper Copier - first site ripping program I tried.
Another way to block bots with htaccess. Define all your bot names into a common name like bad_bot and then just deny any browser env with that name in it. So below would block any browser env with the words ripper, widow or brutus in them. This is just an example. Use what you need in your deny list along with any other things you have denied like IP's and such.

Code:
BrowserMatchNoCase Ripper bad_bot
BrowserMatchNoCase Widow bad_bot
BrowserMatchNoCase Brutus bad_bot
Order Deny,Allow
Deny from env=bad_bot

Last edited by SplatterMaster; 04-15-2013 at 10:25 AM..
SplatterMaster is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote