Thread: Why does Google decide Robots.txt no longer works?
View Single Post
Old 12-13-2013, 08:57 AM  
wehateporn
Promoting Debate on GFY
 
wehateporn's Avatar
 
Industry Role:
Join Date: Apr 2007
Posts: 27,173
Quote:
Originally Posted by rowan View Post
I'd be more concerned about why your server is generating a 500 internal server error for a simple 404 file not found.
Still not certain what caused the change, but have used .htaccess to switch the 500 to 404
__________________
wehateporn is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote