Quote:
Originally Posted by Waddymelon
Annoying isnt it? I've had googlebot hit my servers up to 15 times per second, for hours at a time. Dynamic pages really make googlebot go nuts.
|
15times in a second?! really annoying! well its a smart idea to disallow the googlebot.. thanks for the advice guys.