Thread: Search engines and password protected directories?
View Single Post
Old 03-26-2012, 12:36 AM  
rowan
Too lazy to set a custom title
 
Join Date: Mar 2002
Location: Australia
Posts: 17,393
Quote:
Originally Posted by ottopottomouse View Post
if you do let googlebot in anybody with a user agent switcher is in too.
Of course, that's why you restrict access with both the user-agent and IP range.
rowan is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote