New Cloudflare AI Scrapers and Crawlers Filter

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Shoplifter
    Richest man in Babylon
    • Jan 2002
    • 5846
    #1

    New Cloudflare AI Scrapers and Crawlers Filter

    Anyone else using this? On some of my sites it's blocking > 50k a day. CPU load has fallen commensurably

    Any thoughts on this? Downsides?
    Tags: None
    • gar
      Confirmed User
      • Feb 2021
      • 462
      #2
      Originally posted by Shoplifter
      Anyone else using this? On some of my sites it's blocking > 50k a day. CPU load has fallen commensurably

      Any thoughts on this? Downsides?
      Been using it since day one it's available but on AWS WAF. AI won't answer your site URL. They're crawling like crazy! Faster and more frequent than Google!
      TubeOrigin

        Comment

        Previous template Next
        Working...