Thread
: Tech
Baning AI Bots from Crawling
View Single Post
04-03-2024, 10:05 AM
sandman!
Icq: 14420613
Industry Role:
Join Date: Mar 2001
Location: chicago
Posts: 15,432
i dont think you can block all the bots , many of them wont bother reading robots.txt
__________________
Need WebHosting ? Email me for some great deals
[email protected]
sandman!
View Public Profile
Visit sandman!'s homepage!
Find More Posts by sandman!