AOL does retarded shit to servers with its shit ass spider.
 

AOLs Spider is fucking stupid as shit.

Mainly from 205.188.209.* my SE pages get fuckign attacked by their stupid spider all the time and I've ended up blocking it.

This thing opens as many Concurent connections as its allowed and will also "attacK" from more than one IP.

I've sraight up blocked most of thier network in IP tables becasue thier crap-ass spider is more trouble than its worth.

Been blocked for almost 7 months now.... Today I open it back up to see what happens. And blam, less than an hour later a fucking 6MB apache log full of 205.188.*.*


GOD DAMN AOL, YOU ARE FUCKING RETARDED!!!!!



Rant over.

That sucks, I was hoping you were have a better day.

:(

HEheh. IM always having a good day. The shit before was a "joke" seemed like fun to go nuts. And this doesnt HURT anything.... its just kinda pathetic how crappy thier crawler is.

no i heard the new aol 9.0 is the shiznit :winkwink:

:waaaaahh boo fucking hoo

:1orglaugh :1orglaugh :1orglaugh

i got the google toolbar this page has a pr1 ranking :stoned

Intresting, I'm gonna check my logs today.
how many apache connections do you allow?

Obviously this is the fault of one of the most successfull online businesses and the biggest ISP. Most definately not the fault of some assclown who can't create a spider-friendly site or use a robots.txt file.

:1orglaugh :1orglaugh :1orglaugh

our logs don't show AOL going nutty, looks good for our servers

http://www.webmasterworld.com/forum39/1122.htm


Sorry for all you jackass who think you know everything and don't have any #1 google terms. But some of us with high ranked sites who keep a sharp eye on what is actually going on with our servers might know slightly more than the local GFY troll who can post 3 laughing smilies.

BTW... if the spider is coming directly through a google caced version of your page it still tryes to gobble every image without ever checking the robots.txt file.