Thread: google spidering takes more bandwidth now
View Single Post
Old 06-19-2004, 09:44 AM  
mardigras
Bon temps!
 
Join Date: Feb 2003
Location: down yonder
Posts: 14,194
You can block Google with robots.txt if you think they are taking too much of your bandwidth
__________________
.
mardigras is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote