Quote:
Originally Posted by Insane Matt
Can someone explain what you use the 'robot.txt' in your root files for wordpress for...
|
It basically lets you disallow search engines from indexing parts of your site by referencing that part in the robots.txt file. Read more about it at
this Wikipedia article.
Just so you know, the file needs to be "robot
s.txt" or it won't be read by the search engines.