![]() |
robots.txt question
my index page is just a redirect to my forum area, now most of my traffic just goes right to the forums. Does google bot check the root no matter what for the robots.txt file? Or I guess what am asking is if google checks each directory for a robots file or just the root.
so if I wanted a whole directory off limts to google can I just put a robot file in it or do I have to specify that dir from the root robot file? |
It should check /robots.txt and not /forum/robots.txt
I don't see why it would do the /forum/robots.txt WiredGuy? |
with a robots.txt file you're telling google which directories to crawl and which not to crawl..
and it goes in your main directory .. public_html or whatever it is |
ok thanks.
|
All times are GMT -7. The time now is 08:40 PM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123