Thread: bot-blocking with .htaccess
View Single Post
Old 01-29-2003, 10:50 AM  
HQ
Confirmed User
 
Join Date: Jan 2001
Posts: 3,539
Show me an example of a robots.txt file that denies bots (but allows search engine bots), please.
HQ is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote