Skip to content

Identifying careless responses in survey data.

Adam W. Meade, S. Bartholomew Craig

Psychological Methods · 2012 · 4,369 citations

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085

In text: (Meade & Craig, 2012)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

When data are collected via anonymous Internet surveys, particularly under conditions of obligatory participation (such as with student samples), data quality can be a concern. However, little guidance exists in the published literature regarding techniques for detecting careless responses. Previously several potential approaches have been suggested for identifying careless respondents via indices computed from the data, yet almost no prior work has examined the relationships among these indicators or the types of data patterns identified by each. In 2 studies, we examined several methods for identifying careless responses, including (a) special items designed to detect careless response, (b) response consistency indices formed from responses to typical survey items, (c) multivariate outlier analysis, (d) response time, and (e) self-reported diligence. Results indicated that there are two distinct patterns of careless response (random and nonrandom) and that different indices are needed to identify these different response patterns. We also found that approximately 10%-12% of undergraduates completing a lengthy survey for course credit were identified as careless responders. In Study 2, we simulated data with known random response patterns to determine the efficacy of several indicators of careless response. We found that the nature of the data strongly influenced the efficacy of the indices to identify careless responses. Recommendations include using identified rather than anonymous responses, incorporating instructed response items before data collection, as well as computing consistency indices and multivariate outlier analysis to ensure high-quality data.

  1. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error1981
  2. The Hospital Anxiety and Depression Scale1983
  3. Coefficient Alpha and the Internal Structure of Tests1951
  4. An Inventory for Measuring Depression1961
  5. A new criterion for assessing discriminant validity in variance-based structural equation modeling2014

Metadata from OpenAlex (CC0). Citations are generated from the published record.