![]() |
robots.txt quick question
it is any difference for robots/spiders between these 2 siteuations:
1. the robots.txt file don't exist on my site 2. robots.txt file exist on my site but is an empty file if yes, what is the difference for spiders? |
you won't get a bunch of 404s but other than that it is the same.
|
All times are GMT -7. The time now is 04:42 PM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123