SPIN Unprocessed
Source Techmeme techmeme.com Media Center
October 30, 2026 ai_technology technology

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers (Emma Roth/The Verge)

View original on techmeme.com

Overview

Emma Roth / The Verge: OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers — The new control will allow publishers to apply their AI training preferences across multiple crawlers.

SpinGraph analysis pending — check back after processing.

Ask AI about this story

Opens with the SpinGraph .md URL and structured context — one click, prompt included.

More from Techmeme

View all →

Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO