AI 基礎設施與網路標準
Cloudflare Separates Search, Training, and Agent Crawler Controls, but Bing’s Training Opt-Out Signal Is Not Yet Automatic
Cloudflare has introduced “Disallow AI Training,” combining `robots.txt` preferences with network-layer classification so websites can remain indexed by search engines while opting out of model training. Existing settings will be migrated automatically, but support varies across Applebot, Googlebot, and Bingbot—and selecting Block by mistake could still directly sacrifice search visibility.