The biggest names in AI are backing a new way to opt out of scraping
Source: The Verge (opens in a new tab) · Emma Roth
Intel Summary
OpenAI, Google, Microsoft, and Anthropic have agreed to adopt a unified standard allowing web publishers to opt out of AI scraping. The mechanism relies on a shared policy token signal, enabling website operators to apply AI training data preferences across multiple AI vendors simultaneously rather than managing individual crawler exclusion rules.
Why It Matters
Standardizing scraping opt-out signals simplifies content governance for digital publishers and enterprise webmasters who previously managed fragmented bot permissions. This establishes a collective technical framework for data rights and training consent among the leading AI model developers, streamlining how content owners control commercial ingestion.
Organizations & Entities
Related Intelligence
- ReportAlso involving OpenAI
Google opens Android development to third-party AI agents and unveils new Gemini APIs
Google has expanded Android Studio to support third-party AI agents via a new 'Bring Your Own Agent' feature, integrating more than 40 external coding agents including Anthropic's Claude Agent and OpenAI's Codex. According to Google, new terminal tools also enable agents to complete UI tasks 77 percent faster using up to three times fewer tokens.
The Decoder - ReportAlso involving OpenAI
Shadowy AI Relay Disables OpenAI Codex, Claude Code Sandboxes
Dark Reading reports that an unidentified relay service is distributing AI coding tools, including OpenAI Codex and Claude Code, to mainland China and other unsupported regions. The proxy service reportedly operates with key built-in sandbox security controls disabled.
Dark Reading - ReportAlso involving OpenAI
OpenAI’s Astra Model Becomes Top Distillation Target for China’s AI Labs
Chinese artificial intelligence developers, including DeepSeek and Moonshot AI, are relying heavily on outputs from OpenAI's GPT-6 Astra to train their own latest models through distillation, according to reporting from The Information. The practice remains a primary driver of capability gains for Chinese open-weight models despite persistent industry criticism.
The Information - ReportAlso involving OpenAI
Microsoft recorded $10 billion in revenue from OpenAI
TechCrunch reports that Microsoft recorded $10 billion in revenue from commercial arrangements with OpenAI, including revenue-sharing payments, for the quarter ending September 30.
TechCrunch