GoFuckYourself.com - Adult Webmaster Forum

- Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)

- - SE Spiders (https://gfy.com/showthread.php?t=86228)

kenny

11-03-2002 03:29 PM

SE Spiders

I use index.html pages to redirect surfers who try to go up a directory level will this prevent SE spiders from spidering the directories?

Ace-Ace

11-03-2002 03:32 PM

Was that a question or statement? I'm confused...

hyper

11-03-2002 03:38 PM

why not just put -indexes in your .htaccess

funkmaster

11-03-2002 03:44 PM

spiders get exactly what a surfer with deactivated scripting gets ... so in your case, the spider will get redirected ...

All times are GMT -7. The time now is 07:17 AM.