|
robots.txt is entirely optional - as said above, it can instruct spiders to ignore certain parts of your site if you desire.
The 404 errors on that file will almost entirely be spiders checking for the file before examining your site. It won't stop them from indexing your site.
__________________
<p><font size="2" face="Arial, Helvetica, sans-serif"><a href="http://www.maddoghouse.com"><img src="http://www.maddoghouse.com/images_global/mdhlogo60x45_GFYbutton_black.jpg" width="60" height="45" border="0">MadDogHouse.com</a></font></p>
|