Skip to content

Experimental evidence on the productivity effects of generative artificial intelligence

Shakked Noy, Whitney Zhang

Science · 2023 · 2,999 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192. https://doi.org/10.1126/science.adh2586

In text: (Noy & Zhang, 2023)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

We examined the productivity effects of a generative artificial intelligence (AI) technology, the assistive chatbot ChatGPT, in the context of midlevel professional writing tasks. In a preregistered online experiment, we assigned occupation-specific, incentivized writing tasks to 453 college-educated professionals and randomly exposed half of them to ChatGPT. Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%. Inequality between workers decreased, and concern and excitement about AI temporarily rose. Workers exposed to ChatGPT during the experiment were 2 times as likely to report using it in their real job 2 weeks after the experiment and 1.6 times as likely 2 months after the experiment.

  1. Machine learning: Trends, perspectives, and prospects2015
  2. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy2023
  3. Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy2019
  4. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play2018
  5. Artificial neural networks: a tutorial1996

Metadata from OpenAlex (CC0). Citations are generated from the published record.