Quote:
Originally Posted by EBORG9
So all this bandwidth is Yahoo continuously crawling and duplicating content over several IP's?
It's been going on now for a month.
|
Bots can crash your machines if you get them stuck in loops so making awstats look like it's burning a lot of bw is probably easy.
I'm not sure about duplicate content over several ip's - but you can duplicate trash translations on the same domain 100's of times and google/yahoo will give you an amazing amount of trash translated listings.