Skip to main content
EnterpriseRegulationSecurity

Google, Anthropic and others to support new AI crawling opt-out standard

Source: SiliconANGLE (opens in a new tab) · Maria Deutscher

Intel Summary

Google, Microsoft, Anthropic, and OpenAI have announced plans to support an upcoming website crawling standard. The proposed mechanism will allow website operators to explicitly block artificial intelligence developers from scraping their online content for model training purposes.

Why It Matters

Adoption of a unified standard by major foundation model developers gives content owners and web administrators a recognized protocol to protect proprietary text and data from unauthorized ingestion without relying on fragmented, vendor-specific opt-out lists.

Organizations & Entities

Topics