Originally Posted by rowan

Googlebot is probably assuming (reasonably) that if a fetch attempt returns a 500, your site has problems.

I'd be more concerned about why your server is generating a 500 internal server error for a simple 404 file not found.