Originally Posted by Libertine

Do you perhaps have a redirect for your favicon in your .htaccess?

That would explain why changing the name would break it even if it worked under another name - it would still be trying to show you something else from another location.