GoFuckYourself.com - Adult Webmaster Forum - View Single Post - Anyone Familiar with error logs, know what this is?

Web_Mistress · 04-22-2001, 12:37 PM

I was checking out my error logs (I'm a bit parinoid after what happened at my last hos[Fri Apr 20 15:12:43 2001] [error] [client ip address] File does not exist: /server path url/robots.txt)

What might be looking for a robots.txt file on my main root domain of my server? I find this error in all my domains. Is this a search engine? Something to worry about?

04-22-2001, 12:37 PM
Web_Mistress Confirmed User Join Date: Feb 2001 Location: Las Vegas, NV Posts: 374	Anyone Familiar with error logs, know what this is? I was checking out my error logs (I'm a bit parinoid after what happened at my last hos[Fri Apr 20 15:12:43 2001] [error] [client ip address] File does not exist: /server path url/robots.txt) What might be looking for a robots.txt file on my main root domain of my server? I find this error in all my domains. Is this a search engine? Something to worry about?