Back to News

Regulation · 31 Oct 2026

AI providers back a shared robots.txt signal for AI training preferences, with staggered rollout

Selected and summarised by the CAIO Today editors · Original reporting: Sam on AI

Image: Sam on AI

A common way for websites to express AI training preferences is being adopted across providers, though timing differs: OpenAI plans implementation in the coming months, while Microsoft's preferences take effect February 1, 2027. The proposal remains an individual internet draft without IETF endorsement and is voluntary.

Why it matters for AI leaders

Content-use policies for AI training and grounding are shifting, so legal and data teams should track publisher opt-out signals and deadlines that affect the data an organisation can use or retrieve.

Source: Sam on AI · samonai.substack.com

Read the full story

More news

Regulation · 30 Oct 2026SEC enforcement chief warns AI firms to get their disclosures rightRegulation · 30 Oct 2026New York bill would add incident disclosure and independent safety oversight for large AI developersEthics · 31 Oct 2026Gulf experts say criminals use AI agents to run cheaper, larger-scale cyber scams