A Framework for Interpretability in Machine Learning for Medical Imaging.

Publication Type	Academic Article
Authors	Wang A, Karaman B, Kim H, Rosenthal J, Saluja R, Young S, Sabuncu M
Journal	IEEE Access
Volume	12
Pagination	53277-53292
Date Published	04/11/2024
ISSN	2169-3536
Abstract	Interpretability for machine learning models in medical imaging (MLMI) is an important direction of research. However, there is a general sense of murkiness in what interpretability means. Why does the need for interpretability in MLMI arise? What goals does one actually seek to address when interpretability is needed? To answer these questions, we identify a need to formalize the goals and elements of interpretability in MLMI. By reasoning about real-world tasks and goals common in both medical image analysis and its intersection with machine learning, we identify five core elements of interpretability: localization, visual recognizability, physical attribution, model transparency, and actionability. From this, we arrive at a framework for interpretability in MLMI, which serves as a step-by-step guide to approaching interpretability in this context. Overall, this paper formalizes interpretability needs in the context of medical imaging, and our applied perspective clarifies concrete MLMI-specific goals and considerations in order to guide method design and improve real-world usage. Our goal is to provide practical and didactic information for model designers and practitioners, inspire developers of models in the medical imaging field to reason more deeply about what interpretability is achieving, and suggest future directions of interpretability research.
DOI	10.1109/access.2024.3387702
PubMed ID	39421804
PubMed Central ID	PMC11486155