Abstract: Providing appropriate explanations to deep learning-based image captioning models is essential to enable users to trust the generated captions. In this paper, we present a novel approach for ...