Quantitative Evaluation of Video Explainability Methods via Anomaly Localization

Research output: Chapter in Book/Report/Conference proceedingConference paper

Abstract

This paper presents a study of explainable AI methods applied to video anomaly detection. Specifically, we put forward a multidimensional evaluation protocol to evaluate attribution methods by considering the correctness of the explanations, their plausibility with respect to ground-truth anomaly data, and the robustness of explanations across multiple time frames. We evaluate these metrics on common gradient-based and perturbation-based explanation techniques, which we use to explain a 3DCNN-based classifier trained on real video data. Our results show that using specific methods generally leads to trade-offs in explanation performance, which include the higher computational cost related to video data. In particular, gradient-based methods achieve higher robustness across multiple frames, whereas perturbation methods achieve higher model fidelity scores.
Original languageEnglish
Title of host publication2023 31st European Signal Processing Conference (EUSIPCO)
PublisherIEEE
Pages1235-1239
Number of pages5
ISBN (Electronic)978-9-4645-9360-0
DOIs
Publication statusPublished - 29 Oct 2023
Event31st European Signal Processing Conference - Scandic Marina Congress Center, Helsinki, Finland
Duration: 4 Sep 20238 Sep 2023
https://eusipco2023.org/

Publication series

NameEuropean Signal Processing Conference
ISSN (Print)2219-5491

Conference

Conference31st European Signal Processing Conference
Abbreviated titleEUSIPCO 2023
Country/TerritoryFinland
CityHelsinki
Period4/09/238/09/23
Internet address

Bibliographical note

Funding Information:
ACKNOWLEDGEMENT This research received funding from the FWO (Grant 1SB5721N), Belgium.

Publisher Copyright:
© 2023 European Signal Processing Conference, EUSIPCO. All rights reserved.

Fingerprint

Dive into the research topics of 'Quantitative Evaluation of Video Explainability Methods via Anomaly Localization'. Together they form a unique fingerprint.

Cite this