Supporting End-User Understanding of Classification Errors: Visualization and Usability Issues

Emma Beauxis-Aussalet, Joost van Doorn, Lynda Hardman

Research output: Contribution to journalArticleAcademicpeer-review

2 Downloads (Pure)

Abstract

Classifiers are applied in many domains where classification errors have significant implications. However, end-users may not always understand the errors and their impact, as error visualizations are typically designed for experts and for improving classifiers. We discuss the specific needs of classifiers’ end-users and a simplified visualization, called Classee, designed to address them. We evaluate this design with users from three levels of expertise, and compare it with ROC curves and confusion matrices. We identify key difficulties with understanding the classification errors, and how visualizations addressed or aggravated them. The main issues concerned confusions of the actual and predicted classes (e.g., confusion of False Positives and False Negatives). The machine learning terminology, complexity of ROC curves, and symmetry of confusion matrices aggravated the confusions. The Classee visualization reduced the difficulties by using several visual features to clarify the actual and predicted classes, and more tangible metrics and representation. Our results contribute to supporting end-users’ understanding of classification errors, and informed decisions when choosing or tuning classifiers.
Original languageEnglish
Article number3
Pages (from-to)1-29
Number of pages29
JournalThe Journal of Interaction Science
Volume7
DOIs
Publication statusPublished - Oct 2019
Externally publishedYes

Fingerprint Dive into the research topics of 'Supporting End-User Understanding of Classification Errors: Visualization and Usability Issues'. Together they form a unique fingerprint.

Cite this