1 Introduction
2 Preliminary
2.1 Knowledge Scope
2.2 Definition of Knowledge in LLMs
2.3 The Architecture of LLMs
2.4 Knowledge Analysis Methods
3 Knowledge Utilization in LLMs
3.1 Memorization
3.2 Comprehension and Application
3.3 Creation
3.4 Comparison of Different Mechanism Analysis Methods
4 Knowledge Evolution in LLMs
4.1 Individual Evolution
4.2 Group Evolution
4.3 Comparison of Different Evolution Strategies
5 Application of Knowledge Mechanism
5.1 Efficient LLMs
5.2 Trustworthy LLMs
6 Discussion
6.1 What Knowledge Have LLMs Learned?
6.2 Why Is Learned Knowledge Fragile?
6.3 Does Difficult-to-Learn "Dark Knowledge" Exist?
6.4 How to Explore More Knowledge from Interdisciplinary Inspiration?
7 Future Directions
7.1 Parametric VS. Non-Parametric Knowledge
7.2 Embodied Intelligence
7.3 Domain LLMs
8 Conclusion