|
search.msn.com - msnbot
For those SE people in the crowd, I am sure you have been, and are, being spidered constantly by the msnbot.
It started months ago, around the time Google and Yahoo broke.
At this point they have spidered my whole portfolio of domains and every page (about 400K per domain) over and over.
Does anyone have any info on when they plan on doing something?
At this point I am about to ban the entire IP range, as it is providing no value.
-dd
|