|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
10-28-2004, 08:42 AM
|
#1 |
|
Confirmed User
Join Date: Jun 2002
Location: france
Posts: 996
|
robots.txt quick question
it is any difference for robots/spiders between these 2 siteuations:
1. the robots.txt file don't exist on my site 2. robots.txt file exist on my site but is an empty file if yes, what is the difference for spiders? |
|
|
|
10-28-2004, 08:44 AM
|
#2 |
|
Confirmed User
Join Date: Aug 2002
Location: Montreal
Posts: 154
|
you won't get a bunch of 404s but other than that it is the same.
|
|
|
|
