Quote:
|
Originally Posted by azguy
I understand the need to decrease the amount of traffic and server load used by spiders. What I was originally saying is that the 'content theft' excuse is not the right one. At the time of the actual crawling, the sites did not republish anything as far as you know. Since they use proxies, you have no idea who they are doing all that work for.
|
We know more than you think we do. We have been fighting this for years. Longer than you have been a member. Man, you make a lot of assumptions and it's humorous to see your posts applied to the "real" working knowledge of this site.