Thread: Y'all ever had problems with google crawl rate?
View Single Post
Old 11-26-2019, 04:52 AM  
Klen
 
Klen's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
I had once also agreggator tube server taken down by semrush bot. All those crawling bots are really badly configured.
Klen is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote