Thread: Tech Baning AI Bots from Crawling
View Single Post
Old 04-05-2024, 09:40 PM  
money biz
Confirmed User
 
Join Date: Jan 2003
Posts: 971

1500+ records in robots.txt does that make site slower?
money biz is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote