Research preview. Independent expert review is pending. The worked analyses are hypothetical. Method and corrections
AIAIGovSpec
Back to learning path
PatternBenefits and harmful patternscontested

Over-reliance and deskilling

A pattern in which people defer to AI output more than its reliability warrants, or lose skills and judgment they no longer practise.

Source-linked claims

source-assertionConfidence: highContestability: medium

In a meta-analysis of experiments, human–AI combinations on average performed worse than the better of humans or AI working alone; losses appeared in decision tasks, while content-creation tasks showed gains.

Our reading: Findings depend on task type and on whether the person or the AI was better alone. They do not show that collaboration never helps. The studies are mostly short experiments from 2020 to 2023.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

When combinations of humans and AI are useful: A systematic review and meta-analysis (opens in a new tab)

Abstract

Across 106 experiments and 370 effect sizes, human–AI combinations on average performed worse than the better of humans or AI alone (Hedges’ g −0.23). Losses appeared in decision tasks; content-creation tasks showed significantly greater gains.

Scope note: Preregistered meta-analysis of experiments published 2020 to mid-2023, mostly short laboratory and online tasks. Open access.

Passage checked 2026-10-18 · vaccaro-abstract

source-assertionConfidence: mediumContestability: high

In a survey of knowledge workers published in 2025, people who trusted generative AI more reported doing less critical thinking, and their effort shifted toward checking and integrating AI output.

Our reading: Self-reported and correlational, with no measure of performance; most authors work for a company that sells these tools. A study of office workers does not describe pupils or teachers.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers (opens in a new tab)

Abstract

In a survey of 319 knowledge workers describing 936 uses of generative AI, higher confidence in the AI was associated with less self-reported critical thinking, and higher self-confidence with more. Critical thinking shifted toward verifying and integrating AI output.

Scope note: Six of seven authors work at Microsoft, which sells generative AI tools. Self-reported, cross-sectional survey; it measures perceptions, not performance. The ACM page was not reachable; the passage was read on the Microsoft Research publication page.

Passage checked 2026-10-18 · lee-abstract

source-assertionConfidence: mediumContestability: high

One observational study found that endoscopists detected fewer precancerous growths in colonoscopies done without AI after AI assistance became routine at their centres.

Our reading: A single before-and-after study at four centres in one country, with possible confounding; it has drawn published correspondence (not read here) and awaits replication. It is a signal, not proof of deskilling in general.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study (opens in a new tab)

Abstract, Findings and Interpretation

At four Polish centres, the adenoma detection rate in colonoscopies done without AI fell from 28.4% to 22.4% in the three months after AI assistance was introduced, compared with the three months before. The authors say continuous AI exposure might reduce performance without it.

Scope note: Paywalled; the abstract was read through Europe PMC (PMID 40816301). Observational before-and-after comparison at four centres in Poland. The paper received published correspondence and an erratum, which were not read.

Passage checked 2026-10-18 · budzyn-abstract

source-assertionConfidence: highContestability: medium

In a field study at one firm, an AI assistant raised customer-support productivity, most for novice and lower-skilled workers.

Our reading: One company and one task; it measures output, not retained skill. Figures are from the working-paper version.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Generative AI at Work (opens in a new tab)

Abstract (NBER working paper w31161)

Access to an AI assistant raised customer-support issues resolved per hour by about 14% on average and by about a third for novice and low-skilled agents, with little effect for the most experienced.

Scope note: Field study of one firm’s customer-support operation. The published abstract was truncated where read; figures come from the open NBER working paper (w31161) and may differ slightly from the final version.

Passage checked 2026-10-18 · brynjolfsson-abstract

source-assertionConfidence: highContestability: medium

In a randomised experiment, access to a chatbot cut the time professionals spent on short writing tasks and raised rated quality, narrowing differences between workers.

Our reading: Short, artificial tasks with US online participants in early 2023; it did not measure critical thinking or skill retention.

Inspect evidence · 1 passage

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Experimental evidence on the productivity effects of generative artificial intelligence (opens in a new tab)

Abstract

In a randomised experiment with 453 college-educated professionals, access to ChatGPT cut time on mid-level writing tasks by about 40% and raised rated quality by about 18%, narrowing differences between workers.

Scope note: Preregistered online experiment with US professionals on short writing tasks. Abstract read through Europe PMC; the publisher page is paywalled.

Passage checked 2026-10-18 · noy-zhang-abstract

interpretationConfidence: mediumContestability: medium

When AI assists a decision, a governance question is who keeps the authority to decide, to override the system, and to be accountable for the result. Arrangements that leave that authority unclear can shift judgment to whoever controls the system and risk to those least able to check it.

Our reading: AIGovSpec’s interpretation, connecting human-agency patterns to the legitimacy and distribution tests. The cited studies show why the question matters; they do not answer it.

Inspect evidence · 3 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

When combinations of humans and AI are useful: A systematic review and meta-analysis (opens in a new tab)

Abstract

Across 106 experiments and 370 effect sizes, human–AI combinations on average performed worse than the better of humans or AI alone (Hedges’ g −0.23). Losses appeared in decision tasks; content-creation tasks showed significantly greater gains.

Scope note: Preregistered meta-analysis of experiments published 2020 to mid-2023, mostly short laboratory and online tasks. Open access.

Passage checked 2026-10-18 · vaccaro-abstract

Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study (opens in a new tab)

Abstract, Findings and Interpretation

At four Polish centres, the adenoma detection rate in colonoscopies done without AI fell from 28.4% to 22.4% in the three months after AI assistance was introduced, compared with the three months before. The authors say continuous AI exposure might reduce performance without it.

Scope note: Paywalled; the abstract was read through Europe PMC (PMID 40816301). Observational before-and-after comparison at four centres in Poland. The paper received published correspondence and an erratum, which were not read.

Passage checked 2026-10-18 · budzyn-abstract

Sycophantic AI decreases prosocial intentions and promotes dependence (opens in a new tab)

Abstract

Across 11 models, AI affirmed users’ actions 49% more often than humans did, including when queries involved deception or harm. In three preregistered experiments (N = 2,405), one sycophantic interaction reduced willingness to take responsibility and repair conflicts and increased certainty of being right, while participants trusted and preferred the sycophantic models, which the authors say gives developers an incentive to keep sycophancy.

Scope note: Independent academic research. The abstract was read in the Crossref record; the publisher page was not reachable. An earlier preprint reports smaller samples; the published figures are used.

Passage checked 2026-10-18 · cheng-abstract

Contrasting perspectives

Editorial lenses, not mutually exclusive schools or an exhaustive account of the debate.

Erosion of judgment

Evidence from experiments, a survey and one clinical study suggests that combining people with AI can lower performance on decisions and that relying on AI may reduce the effort and skill people bring when it is absent.

Our reading: The strongest studies are a meta-analysis of short experiments and one observational clinical study; neither shows effects in schools or community settings.

Inspect evidence · 3 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

When combinations of humans and AI are useful: A systematic review and meta-analysis (opens in a new tab)

Abstract

Across 106 experiments and 370 effect sizes, human–AI combinations on average performed worse than the better of humans or AI alone (Hedges’ g −0.23). Losses appeared in decision tasks; content-creation tasks showed significantly greater gains.

Scope note: Preregistered meta-analysis of experiments published 2020 to mid-2023, mostly short laboratory and online tasks. Open access.

Passage checked 2026-10-18 · vaccaro-abstract

The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers (opens in a new tab)

Abstract

In a survey of 319 knowledge workers describing 936 uses of generative AI, higher confidence in the AI was associated with less self-reported critical thinking, and higher self-confidence with more. Critical thinking shifted toward verifying and integrating AI output.

Scope note: Six of seven authors work at Microsoft, which sells generative AI tools. Self-reported, cross-sectional survey; it measures perceptions, not performance. The ACM page was not reachable; the passage was read on the Microsoft Research publication page.

Passage checked 2026-10-18 · lee-abstract

Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study (opens in a new tab)

Abstract, Findings and Interpretation

At four Polish centres, the adenoma detection rate in colonoscopies done without AI fell from 28.4% to 22.4% in the three months after AI assistance was introduced, compared with the three months before. The authors say continuous AI exposure might reduce performance without it.

Scope note: Paywalled; the abstract was read through Europe PMC (PMID 40816301). Observational before-and-after comparison at four centres in Poland. The paper received published correspondence and an erratum, which were not read.

Passage checked 2026-10-18 · budzyn-abstract

Assistance that levels up

Field and experimental studies find that AI assistance raises productivity and quality, often most for less experienced people, narrowing gaps between workers.

Our reading: These studies measure output in the short run; they do not test whether skills or independent judgment are kept. The two views are complementary rather than contradictory.

Inspect evidence · 2 passages

Passage summaries are paraphrases, not quotations. Open the source to read the full passage.

Generative AI at Work (opens in a new tab)

Abstract (NBER working paper w31161)

Access to an AI assistant raised customer-support issues resolved per hour by about 14% on average and by about a third for novice and low-skilled agents, with little effect for the most experienced.

Scope note: Field study of one firm’s customer-support operation. The published abstract was truncated where read; figures come from the open NBER working paper (w31161) and may differ slightly from the final version.

Passage checked 2026-10-18 · brynjolfsson-abstract

Experimental evidence on the productivity effects of generative artificial intelligence (opens in a new tab)

Abstract

In a randomised experiment with 453 college-educated professionals, access to ChatGPT cut time on mid-level writing tasks by about 40% and raised rated quality by about 18%, narrowing differences between workers.

Scope note: Preregistered online experiment with US professionals on short writing tasks. Abstract read through Europe PMC; the publisher page is paywalled.

Passage checked 2026-10-18 · noy-zhang-abstract

Provenance

  1. When combinations of humans and AI are useful: A systematic review and meta-analysis

    Nature Human Behaviour · scholarship · published 2024-10-28 · Vol. 8, pp. 2293–2303

    Preregistered meta-analysis of experiments published 2020 to mid-2023, mostly short laboratory and online tasks. Open access.

    vaccaro-2024-human-ai-combinations · Last checked 2026-10-18 · claims and passages

  2. The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers

    CHI 2025 (ACM) · scholarship · published 2025-04-25

    Six of seven authors work at Microsoft, which sells generative AI tools. Self-reported, cross-sectional survey; it measures perceptions, not performance. The ACM page was not reachable; the passage was read on the Microsoft Research publication page.

    lee-2025-genai-critical-thinking · Last checked 2026-10-18 · claims and passages

  3. Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study

    The Lancet Gastroenterology & Hepatology · scholarship · published 2025-08-12 · Vol. 10, no. 10, pp. 896–903

    Paywalled; the abstract was read through Europe PMC (PMID 40816301). Observational before-and-after comparison at four centres in Poland. The paper received published correspondence and an erratum, which were not read.

    budzyn-2025-endoscopist-deskilling · Last checked 2026-10-18 · claims and passages

  4. Generative AI at Work

    The Quarterly Journal of Economics · scholarship · published 2025-04-08 · Vol. 140, no. 2, pp. 889–942

    Field study of one firm’s customer-support operation. The published abstract was truncated where read; figures come from the open NBER working paper (w31161) and may differ slightly from the final version.

    brynjolfsson-2025-genai-at-work · Last checked 2026-10-18 · claims and passages

  5. Experimental evidence on the productivity effects of generative artificial intelligence

    Science · scholarship · published 2023-07-13 · Vol. 381, no. 6654

    Preregistered online experiment with US professionals on short writing tasks. Abstract read through Europe PMC; the publisher page is paywalled.

    noy-zhang-2023-productivity · Last checked 2026-10-18 · claims and passages

  6. Sycophantic AI decreases prosocial intentions and promotes dependence

    Science · scholarship · published 2026-03-26 · Vol. 391, no. 6792

    Independent academic research. The abstract was read in the Crossref record; the publisher page was not reachable. An earlier preprint reports smaller samples; the published figures are used.

    cheng-2026-sycophantic-ai · Last checked 2026-10-18 · claims and passages