Thread: robots.txt question
View Single Post
Old 01-20-2007, 02:49 AM  
bigalownz
Confirmed User
 
bigalownz's Avatar
 
Industry Role:
Join Date: Aug 2005
Location: NEW ZEALAND
Posts: 1,657
but robots.txt dont work with some bots and spiders
__________________
$100 free credit for all hosting needs
bigalownz is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote