errors found in my stats - GoFuckYourself.com

emmanuelle · 04-27-2004, 08:12 AM

I seem to be finding a lot of 404 errors in my stats, for /robots.txt and for /favicon.ico

Can somebody please explain to me what these do and why I should have them?
{need coffee}

thanks!

amph · 04-27-2004, 08:23 AM

robots.txt is a file that tells SE spiders wether or not should they index/crawl your site and what parts of it they should/shouldnt crawl

favicon.ico is an icon that IE displays next to the entries in the bookmarks (favourites) menu

You dont really need any of those

emmanuelle · 04-27-2004, 08:59 AM

thank you

Now why are they coming up as 404? Who is looking for them? Are they standard browser requests?

amph · 04-27-2004, 09:18 AM

Read my post above, think about it for a second and you should figure out the answer

Dildozer · 04-27-2004, 09:25 AM

Spiders ask for the robots.txt
Bookmarkers ask for the favicon.ico (like when you bookmark GFY, you have the hand giving the finger in your bookmarks, that's the favicon)

04-27-2004, 08:12 AM	#1
emmanuelle Confirmed User Join Date: Mar 2003 Location: Oh Canada! Posts: 3,662	errors found in my stats I seem to be finding a lot of 404 errors in my stats, for /robots.txt and for /favicon.ico Can somebody please explain to me what these do and why I should have them? {need coffee} thanks!

04-27-2004, 08:23 AM	#2
amph Confirmed User Join Date: Mar 2003 Location: LaLaLand Posts: 1,245	robots.txt is a file that tells SE spiders wether or not should they index/crawl your site and what parts of it they should/shouldnt crawl favicon.ico is an icon that IE displays next to the entries in the bookmarks (favourites) menu You dont really need any of those __________________ MEATCASH PWNZ THE INTERWEB ____________ ICQ:30768214 ~~~~~~~~~

04-27-2004, 09:18 AM	#4
amph Confirmed User Join Date: Mar 2003 Location: LaLaLand Posts: 1,245	Read my post above, think about it for a second and you should figure out the answer __________________ MEATCASH PWNZ THE INTERWEB ____________ ICQ:30768214 ~~~~~~~~~

04-27-2004, 09:25 AM	#5
Dildozer Confirmed User Join Date: Jul 2002 Location: Montreal Posts: 7,519	Spiders ask for the robots.txt Bookmarkers ask for the favicon.ico (like when you bookmark GFY, you have the hand giving the finger in your bookmarks, that's the favicon) __________________ Spam link here

04-27-2004, 08:59 AM	#3
emmanuelle Confirmed User Join Date: Mar 2003 Location: Oh Canada! Posts: 3,662	thank you Now why are they coming up as 404? Who is looking for them? Are they standard browser requests?