search.msn.com - msnbot

[davidd]

For those SE people in the crowd, I am sure you have been, and are, being spidered constantly by the msnbot.

It started months ago, around the time Google and Yahoo broke.

At this point they have spidered my whole portfolio of domains and every page (about 400K per domain) over and over.

Does anyone have any info on when they plan on doing something?

At this point I am about to ban the entire IP range, as it is providing no value.

-dd

[Eyes_Without_A_Face]

They are on Beta Tests now. Try it at:

http://beta.search.msn.com/

I eard they will start for real until the end of the year

[davidd]

Originally posted by Eyes_Without_A_Face
They are on Beta Tests now. Try it at:

http://beta.search.msn.com/

I eard they will start for real until the end of the year

Okay cool. I just grep'd my logs and beta.search.msn.com showed up a couple hundred times. So it appears I will let them to continue to spider me.

Thanks
-dd

[Eyes_Without_A_Face]

I've been crawled for a few months and I never blocked them. They will put a lot of money on their SE and it´s always good to be included on the index from the start

[davidd]

Originally posted by Eyes_Without_A_Face
I've been crawled for a few months and I never blocked them. They will put a lot of money on their SE and it´s always good to be included on the index from the start

Agreed, it is more irritation than anything.

I am babied by Google and Yahoo, just want another cash cow