Originally Posted by camperjohn64

So I checked and double checked my code and found that I had some code that checked for a cookie to show adult content. This was supposed to check if the browser was Google and let Google see everything even if the "over 18 button" was not clicked.

But the code had a bug, and was refusing to show Google any HTML at all since the Google crawler had not clicked on the "over 18 button" and set the cookie. My override code, to check if Google was coming had a bug.

My heart sank when I saw this. Months of Google crawling and never indexing wasted.