Research preview. Independent expert review is pending. The worked analyses are hypothetical. Method and corrections
AIAIGovSpec
Back to learning path
InstitutionInstitutionsestablished

Regulator or public authority

A legally constituted body that can make, supervise, interpret, or enforce public rules.

Source-linked claims

synthesisConfidence: highContestability: medium

Voluntary frameworks and binding law can share governance goals while creating different duties, enforcement pathways, and evidence burdens.

Inspect evidence · source links · passage review pending

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Artificial Intelligence Risk Management Framework (AI RMF 1.0) (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

Regulation (EU) 2024/1689 — Artificial Intelligence Act (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

source-assertionConfidence: highContestability: low

Representation and coordination in governance are not enough; commitments require implementation and capacity to produce tangible outcomes.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Governing AI for Humanity: Final Report (opens in a new tab)

Executive summary, para. xviii (p. 8)

Representation and coordination are said not to be enough: accountability requires implementation so that commitments translate into tangible outcomes, including capacity development, much of it at national and regional levels.

Scope note: An advisory body report representing a majority consensus of its members in their personal capacity. It is not a UN member-state decision. Page locators refer to the PDF's printed page numbers.

Passage checked 2026-09-06 · un-hlab-implementation

source-assertionConfidence: mediumContestability: high

Algorithmic fraud control in public welfare can subject benefit recipients to mass surveillance and discriminate against marginalized groups; human-rights groups argue such systems should be paused until shown to be lawful and fair.

Our reading: Amnesty’s findings; the Danish authorities dispute parts of them.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Coded Injustice: Surveillance and Discrimination in Denmark’s Automated Welfare State (opens in a new tab)

Executive summary, pp. 8–12

Denmark’s welfare agency runs dozens of fraud-detection models that, Amnesty finds, surveil benefit recipients at scale and risk disproportionately targeting marginalized groups; it calls for a pause until adequate evidence is provided.

Scope note: Affected-community and human-rights voice, based partly on interviews with benefit recipients. Danish authorities dispute parts of its findings.

Passage checked 2026-10-09 · amnesty-denmark-welfare

source-assertionConfidence: highContestability: low

An Africa-led global index finds Global South AI governance relies mostly on non-binding frameworks, leaving a wide North–South gap in responsible-AI capacity.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Global Index on Responsible AI, 2026 Report (opens in a new tab)

Global South findings: “Responsible AI governance is expanding but binding protections remain weak”; Equity

78% of responsible-AI framework cases in Global South countries are non-binding, against 42% in the Global North; average index scores are 27 and 55 respectively.

Scope note: Africa-led research index covering 135 countries and jurisdictions. Its scores reflect its own methodology.

Passage checked 2026-10-09 · girai-non-binding-gap

synthesisConfidence: highContestability: low

By 2025–26, governments and regulators in several countries had acted on companion chatbots and young users: US study orders on effects on children, a California law on disclosure and crisis protocols, an Italian fine that cited missing age verification, and Australian industry codes applied to companions.

Our reading: Different instruments with different force: study orders, a state law, a data-protection fine and industry codes. None is a general ban, and their effects were not yet evaluated.

Inspect evidence · 4 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

FTC Launches Inquiry into AI Chatbots Acting as Companions (opens in a new tab)

Press release

The FTC ordered seven companies offering companion-style chatbots to report how they measure, test and monitor negative effects on children and teens, limit young users’ exposure, and inform users and parents of risks.

Scope note: Announcement of Section 6(b) study orders to seven companies, issued by a 3–0 vote. These are information-gathering orders, not enforcement actions; no published result was found.

Passage checked 2026-10-18 · ftc-6b-scope

California SB 243 (2025), Companion chatbots (opens in a new tab)

Chaptered text, operator duties

Operators must tell users a companion chatbot is AI where a person could think it human, keep and publish a protocol for suicide and self-harm content with crisis referrals, and for users known to be minors, remind them regularly that the bot is AI and to take breaks, and take measures against sexual content.

Scope note: Signed and filed on 13 October 2025. The official legislature site did not load, so the chaptered text was read on LegiScan. Its effective date (expected 1 January 2026 under California’s default rule) was not confirmed on an official page.

Passage checked 2026-10-18 · sb243-minor-duties

AI: the Garante fines the company that operates the chatbot “Replika” (opens in a new tab)

Press release

The Italian data-protection authority fined the operator of a companion chatbot €5 million, finding no legal basis for processing and no age verification despite the company saying minors were excluded.

Scope note: Regulator’s announcement of a €5 million GDPR fine decided on 10 April 2025, including findings on absent age verification. In Italian.

Passage checked 2026-10-18 · garante-replika-age

eSafety report shows AI companions are putting children at risk (opens in a new tab)

Media release

None of four companion services examined had robust age verification; industry codes now apply to companion chatbots, and two services changed access for under-18s in Australia after the notices.

Scope note: Regulator media release from 2026; the page shows no date. It reports transparency notices to four companion services and a survey of Australians aged 10–17.

Passage checked 2026-10-18 · esafety-companion-findings

source-assertionConfidence: highContestability: medium

EU law prohibits AI systems that exploit vulnerabilities due to age to materially distort behaviour in a way likely to cause significant harm.

Our reading: Read through the Commission’s official AI Act Service Desk, which reproduces the consolidated text. How the prohibition applies to companion chatbots has not been tested in court.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Regulation (EU) 2024/1689 — Artificial Intelligence Act (opens in a new tab)

Article 5(1)(b), via the Commission’s AI Act Service Desk

The Act prohibits AI systems that exploit vulnerabilities due to age, disability or social or economic situation to materially distort behaviour in a way that causes or is likely to cause significant harm; the prohibitions apply from 2 February 2025.

Scope note: Original 2024 enactment, not a consolidated current-law or applicability check. Records discuss its text, not whether a provision applies to a particular situation today.

Passage checked 2026-10-18 · eu-ai-act-art5-age

Appears in worked analyses

Provenance

  1. Artificial Intelligence Risk Management Framework (AI RMF 1.0)

    National Institute of Standards and Technology · framework · published 2023-01-26 · 1.0

    nist-ai-rmf-1 · Last checked 2026-09-04 · claims and passages

  2. Regulation (EU) 2024/1689 — Artificial Intelligence Act

    European Union · law · published 2024-07-12 · Official Journal text

    Original 2024 enactment, not a consolidated current-law or applicability check. Records discuss its text, not whether a provision applies to a particular situation today.

    eu-ai-act · Last checked 2026-09-04 · claims and passages

  3. Governing AI for Humanity: Final Report

    United Nations High-level Advisory Body on Artificial Intelligence · report · publication date not recorded · Final report, September 2024 (eISBN 9789211067873)

    An advisory body report representing a majority consensus of its members in their personal capacity. It is not a UN member-state decision. Page locators refer to the PDF's printed page numbers.

    un-hlab-governing-ai · Last checked 2026-09-06 · claims and passages

  4. Coded Injustice: Surveillance and Discrimination in Denmark’s Automated Welfare State

    Amnesty International · report · published 2024-11-13 · EUR 18/8709/2024

    Affected-community and human-rights voice, based partly on interviews with benefit recipients. Danish authorities dispute parts of its findings.

    amnesty-coded-injustice · Last checked 2026-10-09 · claims and passages

  5. Global Index on Responsible AI, 2026 Report

    Global Center on AI Governance · report · published 2026-07-08 · Second edition

    Africa-led research index covering 135 countries and jurisdictions. Its scores reflect its own methodology.

    girai-2026 · Last checked 2026-10-09 · claims and passages

  6. FTC Launches Inquiry into AI Chatbots Acting as Companions

    US Federal Trade Commission · report · published 2025-09-11

    Announcement of Section 6(b) study orders to seven companies, issued by a 3–0 vote. These are information-gathering orders, not enforcement actions; no published result was found.

    ftc-6b-ai-companions-2025 · Last checked 2026-10-18 · claims and passages

  7. California SB 243 (2025), Companion chatbots

    California State Legislature · law · published 2025-10-13 · Chapter 677, Statutes of 2025

    Signed and filed on 13 October 2025. The official legislature site did not load, so the chaptered text was read on LegiScan. Its effective date (expected 1 January 2026 under California’s default rule) was not confirmed on an official page.

    ca-sb243-companion-chatbots · Last checked 2026-10-18 · claims and passages

  8. AI: the Garante fines the company that operates the chatbot “Replika”

    Garante per la protezione dei dati personali (Italy) · report · published 2025-05-19

    Regulator’s announcement of a €5 million GDPR fine decided on 10 April 2025, including findings on absent age verification. In Italian.

    garante-replika-2025 · Last checked 2026-10-18 · claims and passages

  9. eSafety report shows AI companions are putting children at risk

    eSafety Commissioner (Australia) · report · publication date not recorded

    Regulator media release from 2026; the page shows no date. It reports transparency notices to four companion services and a survey of Australians aged 10–17.

    esafety-ai-companions · Last checked 2026-10-18 · claims and passages