|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
02-19-2023, 12:51 PM
|
#1 |
|
Videochat Solutions
Industry Role:
Join Date: Aug 2004
Location: Canada
Posts: 49,499
|
Question for Semrush users
Has anyone taken a look at their server access logs after using Semrush for a while? A client of mine seems to be getting a ton of Bot traffic (several dozens of file requests per minute) all from Semrush bots. What would this be for?
__________________
|
|
|
|
02-19-2023, 01:38 PM
|
#2 |
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
|
My server once crashed due their bot, better to block it on firewall level.
|
|
|
|
02-19-2023, 01:50 PM
|
#3 | |
|
Videochat Solutions
Industry Role:
Join Date: Aug 2004
Location: Canada
Posts: 49,499
|
Quote:
__________________
|
|
|
|
|
|
02-19-2023, 02:17 PM
|
#4 |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,487
|
They're doing link exploration to map out the internal links. I block them (and all other link exploration services).
WG
__________________
I play with Google. |
|
|
|
|
02-19-2023, 02:20 PM
|
#5 | |
|
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
|
Quote:
|
|
|
|
|
|
02-19-2023, 02:24 PM
|
#6 | |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,487
|
Quote:
 WG
__________________
I play with Google. |
|
|
|
|
|
02-19-2023, 03:26 PM
|
#7 |
|
Confirmed Fetishist
Industry Role:
Join Date: Mar 2005
Location: Fetishland
Posts: 11,539
|
use semrush to spy on uncareful competition, block on your sites.
|
|
|
|
|
02-19-2023, 04:21 PM
|
#8 |
|
Bollocks
Industry Role:
Join Date: Jun 2007
Location: Bollocks
Posts: 2,793
|
Are you sure they're Semrush bots, have you looked up the IP addresses? Could be scraper bots pretending to be Semrush and they won't care about your bandwidth.
__________________
Interserver unmanaged AMD Ryzen servers from $73.00 |
|
|
|
|
02-19-2023, 05:53 PM
|
#9 | |
|
Videochat Solutions
Industry Role:
Join Date: Aug 2004
Location: Canada
Posts: 49,499
|
Quote:
__________________
|
|
|
|
|
|
02-20-2023, 12:04 PM
|
#10 |
|
Registered User
Industry Role:
Join Date: Feb 2023
Posts: 6
|
And, if anything, how can they be blocked?
|
|
|
|
|
02-20-2023, 12:09 PM
|
#11 | |
|
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
|
Quote:
|
|
|
|
|
