Thread: Tech Baning AI Bots from Crawling
View Single Post
Old 04-06-2024, 12:16 AM  
TurboB
Confirmed User
 
TurboB's Avatar
 
Industry Role:
Join Date: Dec 2016
Posts: 1,050
Quote:
Originally Posted by money biz View Post
1500+ records in robots.txt does that make site slower?
Why robots.txt? This script does not touch it.
TurboB is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote