1 INTRODUCTION
2 BACKGROUND
2.1 Distributional Hypothesis
2.2 Distributional Representations
2.3 Language Modeling
2.4 Distributional Representations through Language Modeling
3 WORD EMBEDDINGS WITH IMPROVED LANGUAGE MODELS
3.1 Early Word Embeddings
3.2 Embeddings Targeting Specific Semantic Relations
3.3 Sense Embeddings
3.4 Morpheme Embeddings
4 CONTEXTUAL REPRESENTATIONS
5 PERFORMANCE OF WORD REPRESENTATIONS
5.1 Datasets
5.2 Results
6 CONCLUSION