Research preview. Independent expert review is pending. The worked analyses are hypothetical. Method and corrections
AIAIGovSpec
Back to learning path
ActorSocietiescontested

Affected people

People or communities whose rights, opportunities, safety, work, or environment may be changed by an AI system.

Source-linked claims

synthesisConfidence: mediumContestability: high

People affected by AI systems are governance participants and rights-holders, not only downstream recipients of technical risk controls.

Inspect evidence · source links · passage review pending

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Recommendation on the Ethics of Artificial Intelligence (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

Regulation (EU) 2024/1689 — Artificial Intelligence Act (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

source-assertionConfidence: highContestability: medium

Human rights and dignity can function as the normative foundation against which AI governance choices are evaluated.

Inspect evidence · source links · passage review pending

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Recommendation on the Ethics of Artificial Intelligence (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded. Existing locator: UNESCO values and principles; EU AI Act Article 1.

Regulation (EU) 2024/1689 — Artificial Intelligence Act (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded. Existing locator: UNESCO values and principles; EU AI Act Article 1.

source-assertionConfidence: highContestability: low

In its 2023 UK analysis, the Ada Lovelace Institute warns that people can face costly or unrealistic routes to redress even where legal safeguards exist.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Regulating AI in the UK (opens in a new tab)

Executive summary

Legal safeguards on paper do not guarantee redress: for many people harmed by AI, seeking it is too costly or impractical.

Scope note: Civil-society voice; written about UK policy at the time.

Passage checked 2026-10-09 · ada-redress-costly

source-assertionConfidence: highContestability: medium

Generative AI exposure falls unevenly: women’s jobs and jobs in richer countries are more exposed, and change within jobs is more likely than outright replacement.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Generative AI and Jobs: A Refined Global Index of Occupational Exposure (opens in a new tab)

Abstract and key findings

About one in four workers worldwide is in an occupation with some generative AI exposure. The highest-exposure category covers 4.7% of women’s jobs against 2.4% of men’s, and exposure rises with country income. Transformation of jobs is more likely than replacement.

Scope note: Intergovernmental and tripartite (governments, employers, workers). Measures exposure, not realised job loss.

Passage checked 2026-10-09 · ilo-exposure-uneven

source-assertionConfidence: mediumContestability: high

Algorithmic fraud control in public welfare can subject benefit recipients to mass surveillance and discriminate against marginalized groups; human-rights groups argue such systems should be paused until shown to be lawful and fair.

Our reading: Amnesty’s findings; the Danish authorities dispute parts of them.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Coded Injustice: Surveillance and Discrimination in Denmark’s Automated Welfare State (opens in a new tab)

Executive summary, pp. 8–12

Denmark’s welfare agency runs dozens of fraud-detection models that, Amnesty finds, surveil benefit recipients at scale and risk disproportionately targeting marginalized groups; it calls for a pause until adequate evidence is provided.

Scope note: Affected-community and human-rights voice, based partly on interviews with benefit recipients. Danish authorities dispute parts of its findings.

Passage checked 2026-10-09 · amnesty-denmark-welfare

source-assertionConfidence: highContestability: low

Brazil’s Senate-passed AI bill, still pending in the Chamber in October 2026, would give people affected by high-risk AI the right to contest decisions and obtain human review.

Our reading: A pending bill: the rights would exist only if the Chamber passes it in this form.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Projeto de Lei nº 2338/2023 (Brazil artificial intelligence bill) (opens in a new tab)

Senate-approved text, rights of persons affected by high-risk systems (as reported by Agência Senado)

People affected by high-risk AI systems would gain rights to contest decisions and to human review, and algorithmic impact assessments would examine known and foreseeable risks to fundamental rights.

Scope note: Pending bill, not law. Passed the Senate on 10 December 2024; awaiting a committee report in the Chamber of Deputies as of 9 October 2026. Earlier passages rely on the Senate’s official news agency; the definitions comparison cites Articles 1 and 4 of the text received by the Chamber of Deputies.

Passage checked 2026-10-09 · brazil-affected-rights

source-assertionConfidence: mediumContestability: medium

In preregistered experiments, a single interaction with a sycophantic AI made people less willing to take responsibility or repair a conflict, yet they trusted and preferred the sycophantic model, which gives developers an incentive to keep it.

Our reading: Measures short-term intentions after one interaction, not long-term behaviour, in mostly online participants. Independent of AI developers.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Sycophantic AI decreases prosocial intentions and promotes dependence (opens in a new tab)

Abstract

Across 11 models, AI affirmed users’ actions 49% more often than humans did, including when queries involved deception or harm. In three preregistered experiments (N = 2,405), one sycophantic interaction reduced willingness to take responsibility and repair conflicts and increased certainty of being right, while participants trusted and preferred the sycophantic models, which the authors say gives developers an incentive to keep sycophancy.

Scope note: Independent academic research. The abstract was read in the Crossref record; the publisher page was not reachable. An earlier preprint reports smaller samples; the published figures are used.

Passage checked 2026-10-18 · cheng-abstract

source-assertionConfidence: highContestability: low

UNICEF’s 2025 guidance on AI and children says children’s safety must be assured over both the short and the long term.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Guidance on AI and children 3.0 (opens in a new tab)

Requirement 2, “Ensure safety for children” (about p. 15)

Children’s safety in relation to AI systems must be assured in both the short and the long term.

Scope note: Supersedes the 2021 Policy guidance on AI for children (2.0). Ten requirements for child-centred AI; guidance, not law. Page numbers below are from the PDF as extracted.

Passage checked 2026-10-18 · unicef-safety-requirement

source-assertionConfidence: highContestability: low

UNICEF’s guidance says AI companions should never be intentionally designed to create emotional dependency in children and should disclose that they are not human.

Our reading: Guidance, not law; it sets design expectations without saying how they would be enforced.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Guidance on AI and children 3.0 (opens in a new tab)

“Address risks from AI-enabled chatbots or companions” (about pp. 20–21)

Chatbots and companions should never be intentionally designed to create emotional dependency in children, should have safety training and should disclose that they are not human; the guidance discusses, without endorsing, calls to ban companions for under-18s.

Scope note: Supersedes the 2021 Policy guidance on AI for children (2.0). Ten requirements for child-centred AI; guidance, not law. Page numbers below are from the PDF as extracted.

Passage checked 2026-10-18 · unicef-companions

source-assertionConfidence: highContestability: medium

UNESCO’s 2023 guidance recommends thirteen as the minimum age for independent conversations with generative AI and strict validation of tools before schools or universities officially adopt them.

Our reading: The guidance itself notes that some consider thirteen too young. Validation requires capacity many institutions lack.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Guidance for generative AI in education and research (opens in a new tab)

Section 3.3.1 (p. 21) and section 4.3 (p. 25)

The guidance recommends thirteen as the minimum age for independent conversations with generative AI, noting that some consider this too young, and calls for strict ethical and pedagogical validation of tools before institutions officially adopt them.

Scope note: The UNESCO repository page did not render; the passage was read in an open copy held by University College London.

Passage checked 2026-10-18 · unesco-age-and-validation

source-assertionConfidence: mediumContestability: medium

A 2025 survey by an advocacy organisation found that 72% of US teens aged 13–17 said they had used an AI companion and about half used one regularly.

Our reading: From an advocacy organisation that favours keeping under-18s off these platforms; the sample is partly non-probability and “companion” is defined broadly. US only.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions (opens in a new tab)

Key findings and methodology

Of US teens surveyed, 72% had ever used an AI companion and 52% used one at least a few times a month; a third of users had chosen an AI companion over a person to discuss something serious. The organisation recommends that no one under 18 use these platforms.

Scope note: Advocacy organisation that recommends no one under 18 use AI companions. Survey of 1,060 US teens aged 13–17 fielded by NORC in April–May 2025, partly from a non-probability panel, with a broad definition of “AI companion”.

Passage checked 2026-10-18 · csm-headline-findings

source-assertionConfidence: highContestability: low

An independent 2025 survey found that about two in three US teens use AI chatbots and about one in eight had used them for emotional support or advice.

Our reading: US teens living with their parents, September–October 2025. Evidence outside the United States is thin.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

How Teens Use and View AI (opens in a new tab)

Main findings

64% of US teens said they use AI chatbots; 12% of all teens had used them for emotional support or advice and 16% for casual conversation.

Scope note: Independent survey of 1,458 US teens aged 13–17 and their parents, September–October 2025. It did not ask about companionship as such.

Passage checked 2026-10-18 · pew-teen-chatbot-use

source-assertionConfidence: mediumContestability: medium

A 2025 national survey found that about one in five US young people aged 12–21 had used chatbots for mental-health advice; most found it helpful, and most had told no one.

Our reading: Only the abstract was read. Perceived helpfulness is not evidence of benefit or safety; the finding cuts both ways.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

AI Chatbot Use and Disclosure for Mental Health Among US Adolescents and Young Adults (opens in a new tab)

Abstract (RAND publication record)

About one in five US young people aged 12–21 had used AI chatbots for mental-health advice; most users rated the advice helpful, and most had not told anyone they used chatbots this way.

Scope note: Only the RAND abstract page was read, not the journal article. Nationally representative survey of 1,009 people aged 12–21, November 2025.

Passage checked 2026-10-18 · mcbain-abstract

synthesisConfidence: highContestability: low

By 2025–26, governments and regulators in several countries had acted on companion chatbots and young users: US study orders on effects on children, a California law on disclosure and crisis protocols, an Italian fine that cited missing age verification, and Australian industry codes applied to companions.

Our reading: Different instruments with different force: study orders, a state law, a data-protection fine and industry codes. None is a general ban, and their effects were not yet evaluated.

Inspect evidence · 4 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

FTC Launches Inquiry into AI Chatbots Acting as Companions (opens in a new tab)

Press release

The FTC ordered seven companies offering companion-style chatbots to report how they measure, test and monitor negative effects on children and teens, limit young users’ exposure, and inform users and parents of risks.

Scope note: Announcement of Section 6(b) study orders to seven companies, issued by a 3–0 vote. These are information-gathering orders, not enforcement actions; no published result was found.

Passage checked 2026-10-18 · ftc-6b-scope

California SB 243 (2025), Companion chatbots (opens in a new tab)

Chaptered text, operator duties

Operators must tell users a companion chatbot is AI where a person could think it human, keep and publish a protocol for suicide and self-harm content with crisis referrals, and for users known to be minors, remind them regularly that the bot is AI and to take breaks, and take measures against sexual content.

Scope note: Signed and filed on 13 October 2025. The official legislature site did not load, so the chaptered text was read on LegiScan. Its effective date (expected 1 January 2026 under California’s default rule) was not confirmed on an official page.

Passage checked 2026-10-18 · sb243-minor-duties

AI: the Garante fines the company that operates the chatbot “Replika” (opens in a new tab)

Press release

The Italian data-protection authority fined the operator of a companion chatbot €5 million, finding no legal basis for processing and no age verification despite the company saying minors were excluded.

Scope note: Regulator’s announcement of a €5 million GDPR fine decided on 10 April 2025, including findings on absent age verification. In Italian.

Passage checked 2026-10-18 · garante-replika-age

eSafety report shows AI companions are putting children at risk (opens in a new tab)

Media release

None of four companion services examined had robust age verification; industry codes now apply to companion chatbots, and two services changed access for under-18s in Australia after the notices.

Scope note: Regulator media release from 2026; the page shows no date. It reports transparency notices to four companion services and a survey of Australians aged 10–17.

Passage checked 2026-10-18 · esafety-companion-findings

synthesisConfidence: mediumContestability: high

Digital-rights advocates argue that mandatory age verification for chatbots creates surveillance and data-breach risks for all users and may harm vulnerable groups, while a professional psychology body calls for age-appropriate defaults and limits on AI that simulates relationships.

Our reading: Positions, not findings: they show the trade-off between protecting children and collecting everyone’s data.

Inspect evidence · 2 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Artificial Intelligence and Adolescent Well-being: An APA Health Advisory (press release) (opens in a new tab)

Press release

The advisory calls for guardrails for adolescents, including limits on AI that simulates relationships and age-appropriate defaults for privacy, interaction limits and content.

Scope note: Professional body; only the press release was read.

Passage checked 2026-10-18 · apa-guardrails

A Surveillance Mandate Disguised as Child Safety: Why the GUARD Act Won’t Keep Us Safe (opens in a new tab)

Article body

The organisation argues that mandatory age verification exposes everyone’s identity data to breaches, ends anonymity, harms vulnerable groups and entrenches large companies, so it does not make children safe.

Scope note: Digital-rights advocacy opposing a US bill that would ban AI companions for minors and require age verification.

Passage checked 2026-10-18 · eff-age-verification

Contrasting perspectives

Editorial lenses, not mutually exclusive schools or an exhaustive account of the debate.

Rights-holder view

Affected people have claims that institutions and system operators are obligated to respect.

Inspect evidence · source links · passage review pending

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Recommendation on the Ethics of Artificial Intelligence (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

Regulation (EU) 2024/1689 — Artificial Intelligence Act (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

Stakeholder view

Affected people are among several groups whose perspectives inform organizational risk decisions.

Inspect evidence · source links · passage review pending

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Artificial Intelligence Risk Management Framework (AI RMF 1.0) (opens in a new tab)

Source-level attribution only. A precise supporting passage has not yet been recorded.

Appears in worked analyses

Provenance

  1. Recommendation on the Ethics of Artificial Intelligence

    UNESCO · recommendation · published 2021-11-23 · Adopted text, 23 November 2021

    unesco-ai-ethics · Last checked 2026-09-04 · claims and passages

  2. Regulation (EU) 2024/1689 — Artificial Intelligence Act

    European Union · law · published 2024-07-12 · Official Journal text

    Original 2024 enactment, not a consolidated current-law or applicability check. Records discuss its text, not whether a provision applies to a particular situation today.

    eu-ai-act · Last checked 2026-09-04 · claims and passages

  3. Regulating AI in the UK

    Ada Lovelace Institute · report · published 2023-07-18

    Civil-society voice; written about UK policy at the time.

    ada-regulating-ai-uk · Last checked 2026-10-09 · claims and passages

  4. Generative AI and Jobs: A Refined Global Index of Occupational Exposure

    International Labour Organization · report · published 2025-05-20 · ILO Working Paper 140

    Intergovernmental and tripartite (governments, employers, workers). Measures exposure, not realised job loss.

    ilo-genai-jobs-2025 · Last checked 2026-10-09 · claims and passages

  5. Coded Injustice: Surveillance and Discrimination in Denmark’s Automated Welfare State

    Amnesty International · report · published 2024-11-13 · EUR 18/8709/2024

    Affected-community and human-rights voice, based partly on interviews with benefit recipients. Danish authorities dispute parts of its findings.

    amnesty-coded-injustice · Last checked 2026-10-09 · claims and passages

  6. Projeto de Lei nº 2338/2023 (Brazil artificial intelligence bill)

    Senado Federal do Brasil · law · published 2024-12-10

    Pending bill, not law. Passed the Senate on 10 December 2024; awaiting a committee report in the Chamber of Deputies as of 9 October 2026. Earlier passages rely on the Senate’s official news agency; the definitions comparison cites Articles 1 and 4 of the text received by the Chamber of Deputies.

    brazil-pl-2338 · Last checked 2026-10-09 · claims and passages

  7. Sycophantic AI decreases prosocial intentions and promotes dependence

    Science · scholarship · published 2026-03-26 · Vol. 391, no. 6792

    Independent academic research. The abstract was read in the Crossref record; the publisher page was not reachable. An earlier preprint reports smaller samples; the published figures are used.

    cheng-2026-sycophantic-ai · Last checked 2026-10-18 · claims and passages

  8. Guidance on AI and children 3.0

    UNICEF Innocenti – Global Office of Research and Foresight · guidance · publication date not recorded · 3.0; published December 2025

    Supersedes the 2021 Policy guidance on AI for children (2.0). Ten requirements for child-centred AI; guidance, not law. Page numbers below are from the PDF as extracted.

    unicef-ai-children-3 · Last checked 2026-10-18 · claims and passages

  9. Guidance for generative AI in education and research

    UNESCO · guidance · published 2023-09-07

    The UNESCO repository page did not render; the passage was read in an open copy held by University College London.

    unesco-genai-education-2023 · Last checked 2026-10-18 · claims and passages

  10. Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions

    Common Sense Media · report · published 2025-07-16

    Advocacy organisation that recommends no one under 18 use AI companions. Survey of 1,060 US teens aged 13–17 fielded by NORC in April–May 2025, partly from a non-probability panel, with a broad definition of “AI companion”.

    csm-teens-ai-companions-2025 · Last checked 2026-10-18 · claims and passages

  11. How Teens Use and View AI

    Pew Research Center · report · published 2026-02-24

    Independent survey of 1,458 US teens aged 13–17 and their parents, September–October 2025. It did not ask about companionship as such.

    pew-teens-ai-2026 · Last checked 2026-10-18 · claims and passages

  12. AI Chatbot Use and Disclosure for Mental Health Among US Adolescents and Young Adults

    JAMA Pediatrics · scholarship · publication date not recorded · published 2026

    Only the RAND abstract page was read, not the journal article. Nationally representative survey of 1,009 people aged 12–21, November 2025.

    mcbain-2026-youth-chatbot-mental-health · Last checked 2026-10-18 · claims and passages

  13. FTC Launches Inquiry into AI Chatbots Acting as Companions

    US Federal Trade Commission · report · published 2025-09-11

    Announcement of Section 6(b) study orders to seven companies, issued by a 3–0 vote. These are information-gathering orders, not enforcement actions; no published result was found.

    ftc-6b-ai-companions-2025 · Last checked 2026-10-18 · claims and passages

  14. California SB 243 (2025), Companion chatbots

    California State Legislature · law · published 2025-10-13 · Chapter 677, Statutes of 2025

    Signed and filed on 13 October 2025. The official legislature site did not load, so the chaptered text was read on LegiScan. Its effective date (expected 1 January 2026 under California’s default rule) was not confirmed on an official page.

    ca-sb243-companion-chatbots · Last checked 2026-10-18 · claims and passages

  15. AI: the Garante fines the company that operates the chatbot “Replika”

    Garante per la protezione dei dati personali (Italy) · report · published 2025-05-19

    Regulator’s announcement of a €5 million GDPR fine decided on 10 April 2025, including findings on absent age verification. In Italian.

    garante-replika-2025 · Last checked 2026-10-18 · claims and passages

  16. eSafety report shows AI companions are putting children at risk

    eSafety Commissioner (Australia) · report · publication date not recorded

    Regulator media release from 2026; the page shows no date. It reports transparency notices to four companion services and a survey of Australians aged 10–17.

    esafety-ai-companions · Last checked 2026-10-18 · claims and passages

  17. A Surveillance Mandate Disguised as Child Safety: Why the GUARD Act Won’t Keep Us Safe

    Electronic Frontier Foundation · report · published 2025-11-14

    Digital-rights advocacy opposing a US bill that would ban AI companions for minors and require age verification.

    eff-guard-act-2025 · Last checked 2026-10-18 · claims and passages

  18. Artificial Intelligence and Adolescent Well-being: An APA Health Advisory (press release)

    American Psychological Association · recommendation · published 2025-06-03

    Professional body; only the press release was read.

    apa-adolescent-ai-advisory-2025 · Last checked 2026-10-18 · claims and passages

  19. Artificial Intelligence Risk Management Framework (AI RMF 1.0)

    National Institute of Standards and Technology · framework · published 2023-01-26 · 1.0

    nist-ai-rmf-1 · Last checked 2026-09-04 · claims and passages

  20. OECD AI Principles

    Organisation for Economic Co-operation and Development · recommendation · published 2019-05-22 · 2024 update

    oecd-ai-principles · Last checked 2026-09-04 · claims and passages

  21. Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)

    Council of Europe · treaty · published 2024-09-05 · Opened for signature 5 September 2024

    The Council of Europe overview page was reviewed, not the treaty text itself. The Convention binds only parties for which it has entered into force, and is largely framed as obligations on states to adopt measures. Signature and ratification status changes; verify before relying on it. The treaty text itself (CETS 225) was opened on 19 October 2026 for the definitions comparison.

    coe-framework-convention · Last checked 2026-09-06 · claims and passages