I. INTRODUCTION

II. CATEGORIZATION OF DNN COMPRESSION TECHNIQUES

A. Network pruning

B. Sparse representation

C. Bits precision

D. Knowledge distillation

E. Miscellaneous

III. NETWORK PRUNING

IV. SPARSE REPRESENTATION

V. BITS PRECISION

VI. KNOWLEDGE DISTILLATION

VII. MISCELLANEOUS

VIII. DISCUSSIONS AND FUTURE RESEARCH DIRECTIONS