Skip to content

ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?

Samson Tan, Shannon Tan

Journal of Applied Learning & Teaching · 2023 · 2,511 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9

In text: (Rudolph et al., 2023)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

ChatGPT is the world’s most advanced chatbot thus far. Unlike other chatbots, it can create impressive prose within seconds, and it has created much hype and doomsday predictions when it comes to student assessment in higher education and a host of other matters. ChatGPT is a state-of-the-art language model (a variant of OpenAI’s Generative Pretrained Transformer (GPT) language model) designed to generate text that can be indistinguishable from text written by humans. It can engage in conversation with users in a seemingly natural and intuitive way. In this article, we briefly tell the story of OpenAI, the organisation behind ChatGPT. We highlight the fundamental change from a not-for-profit organisation to a commercial business model. In terms of our methods, we conducted an extensive literature review and experimented with this artificial intelligence (AI) software. Our literature review shows our review to be amongst the first peer-reviewed academic journal articles to explore ChatGPT and its relevance for higher education (especially assessment, learning and teaching). After a description of ChatGPT’s functionality and a summary of its strengths and limitations, we focus on the technology’s implications for higher education and discuss what is the future of learning, teaching and assessment in higher education in the context of AI chatbots such as ChatGPT. We position ChatGPT in the context of current Artificial Intelligence in Education (AIEd) research, discuss student-facing, teacher-facing and system-facing applications, and analyse opportunities and threats. We conclude the article with recommendations for students, teachers and higher education institutions. Many of them focus on assessment.

  1. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT2023
  2. The Dishonesty of Honest People: A Theory of Self-Concept Maintenance2008
  3. Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling2012
  4. How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data2009
  5. Behavioral Ethics in Organizations: A Review2006

Metadata from OpenAlex (CC0). Citations are generated from the published record.