Quote:
Originally Posted by hateman
Every other? There is only 2 engines worth worrying about: Google and Yahoo.
And if your domain is banned, you don't have any pages listed anyway.
Besides, you can do this just for Google by specifying only their crawl bot in the robots.xtx
|
You can do it just for google in the .htaccess as well (at least for the official bots), since google doesn't care for the robots.txt as much as they should...the spider is way to curious, they may not list the stuff, but they still crawl it.
It's not a bad tip, although from my impression any domain comes back sooner or later. Some take months, some take years, just sit, wait, do nothing...the zombies will raise!