1 INTRODUCTION

2 SURVEY METHODOLOGY
2.1 Research Questions
2.2 Search Strategy
2.3 Study Selection
2.4 Trend Observation

3 RQ1: HOW ARE LLMS DESIGNED TO SUPPORT CODE-RELATED TASKS?
3.1 RQ1.1: What LLMs have been released to support SE?
3.2 RQ1.2: How are LLMs used in pre-training tasks?
3.3 RQ1.3: How are LLMs used in downstream tasks?
3.4 RQ1.4: How are LLMs open-sourced to support the open science community?

4 RQ2: HOW ARE LLMS USED IN SOFTWARE ENGINEERING RESEARCH?
4.1 Software Requirements & Design
4.2 Software Development
4.3 Software Testing
4.4 Software Maintenance

5 RQ3: HOW ARE LLMS EMPIRICALLY EVALUATED IN SE RESEARCH?
5.1 Benchmark
5.2 Empirical Studies
5.3 Empirical Exploration of SE Education

6 RQ4: OPTIMIZATION AND APPLICATIONS
6.1 Security Attack
6.2 LLMs Tuning
6.3 LLM Compressing

7 CHALLENGES AND OPPORTUNITIES

8 CONCLUSION