View Single Post
Old 12-12-2013, 06:00 PM  
wehateporn
Promoting Debate on GFY
 
wehateporn's Avatar
 
Industry Role:
Join Date: Apr 2007
Posts: 27,173
Why does Google decide Robots.txt no longer works?

On a shared server you have no robots.txt for your sites, Google has always been happy, then one day Google decides it's no longer happy with any of the sites on that server, it claims it can't access the robots.txt for them. I see it expects 404 if there's no robots.txt but my server gives Error 500, according to forums that causes a problem.

Has anyone else had this type of problem, it should be easy enough to fix, but anyone know what likely caused the change? Change of settings on the shared server?

Cheers
__________________
wehateporn is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote