Originally Posted by freecartoonporn

500 is your issue, you have to solve it, either give him 404 or 200


if google is asking for it then give it one.
create a blank robots.txt

i done this before. or the bot starts hitting it and it floods the fucking error logs.