Skip to content

A Survey of Methods for Explaining Black Box Models

Riccardo Guidotti, Anna Monreale, Franco Turini, Fosca Giannotti, Dino Pedreschi

ACM Computing Surveys · 2018 · 6,035 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2018). A survey of methods for explaining black box models. ACM Computing Surveys, 51(5), 1–42. https://doi.org/10.1145/3236009

In text: (Guidotti et al., 2018)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

In recent years, many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The literature reports many approaches aimed at overcoming this crucial weakness, sometimes at the cost of sacrificing accuracy for interpretability. The applications in which black box decision systems can be used are various, and each approach is typically developed to provide a solution for a specific problem and, as a consequence, it explicitly or implicitly delineates its own definition of interpretability and explanation. The aim of this article is to provide a classification of the main problems addressed in the literature with respect to the notion of explanation and the type of black box system. Given a problem definition, a black box type, and a desired explanation, this survey should help the researcher to find the proposals more useful for his own work. The proposed classification of approaches to open black box models should also be useful for putting the many research open questions in perspective.

  1. Classification and Regression Trees.1984
  2. The WEKA data mining software2009
  3. The random subspace method for constructing decision forests1998
  4. Mining frequent patterns without candidate generation2000
  5. Mining association rules between sets of items in large databases1993

Metadata from OpenAlex (CC0). Citations are generated from the published record.