How to spot a fabricated reference before your reader does
Anchorcite team · 4 min read ·

Why this matters
A fabricated reference looks exactly like a real one: plausible authors, a real journal, a believable title. It is the kind of error that AI writing tools produce, and it is easy to miss. In one study, researchers asked ChatGPT-3.5 and ChatGPT-4 to write short literature reviews on 42 topics, then checked all 636 references by hand. More than half of the GPT-3.5 references did not exist, and the newer model still invented almost one in five. 1
“Within this set of documents, 55% of the GPT-3.5 citations but just 18% of the GPT-4 citations are fabricated. Likewise, 43% of the real (non-fabricated) GPT-3.5 citations but just 24% of the real GPT-4 citations include substantive citation errors.”
Five checks for every reference
None of these takes more than a minute, and most references pass the first one.
- Open the DOI at doi.org. A DOI that does not resolve, or resolves to a different paper, is the fastest warning sign there is.
- Search the exact title in quotation marks in Crossref, OpenAlex or Google Scholar.
- Check that the journal, year, volume and pages match the record you find.
- Check the author list on the publisher's page, not only in a database.
- Open the paper and find the passage that supports your sentence.
One database is not enough
Databases disagree, so a mismatch is a reason to look again, not proof of fabrication. While checking a 1990 JAMA paper on retracted research for another post, we found that Crossref lists a single author, Mark P. Pfeifer, while PubMed lists two: Pfeifer MP and Snodgrass GL. Both records describe the same, very real paper.
A reference that names both authors is correct, even though one database disagrees. When your reference and one record differ, check a second source, and the publisher's own page, before you change or delete anything.
Checking a whole reference list
For a long bibliography, paste it into the free reference checker. It looks up every entry in Crossref and OpenAlex and marks each one verified, corrected, not found or retracted.
Treat "not found" as a prompt to check by hand, not as a verdict: books, reports and very new papers are not always indexed. And a reference that exists can still be cited for something it does not say, which only reading the passage will catch.
References
- 1.Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations generated by ChatGPT. Scientific Reports, 13(1), 14045. https://doi.org/10.1038/s41598-023-41032-5