CCS Concepts: General and reference → Surveys and overviews; Computing methodologies → Knowledge representation and reasoning; Neural networks.

1 INTRODUCTION

2 TAXONOMY FOR INTERPRETABLE CROSS-MODAL REASONING
2.1 Taxonomy of Visual Explanation
2.2 Taxonomy of Textual Explanation
2.3 Taxonomy of Graph Explanation
2.4 Taxonomy of Symbol Explanation
2.5 Taxonomy of Multimodal Explanation

3 VISUAL EXPLANATION

4 TEXTUAL EXPLANATION

5 GRAPH EXPLANATION

6 SYMBOL EXPLANATION

7 MULTIMODAL EXPLANATION

8 DATASETS

9 CHALLENGES AND FUTURE DIRECTIONS
9.1 Inaccurate Grounding of Visual Objects
9.2 Evaluation of Graph and Symbol Explanations
9.3 Multimodal Explanation Annotations
9.4 User-friendliness and User-interaction
9.5 Comprehensive Explanation Based on Large Language Models

10 CONCLUSIONS