Commit
·
d923c34
1
Parent(s):
c3ab6e2
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# XLM-Align
|
| 2 |
+
|
| 3 |
+
**Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment** (ACL-2021, [paper](https://arxiv.org/pdf/2106.06381.pdf), [github](https://github.com/CZWin32768/XLM-Align))
|
| 4 |
+
|
| 5 |
+
XLM-Align is a pretrained cross-lingual language model that supports 94 languages. See details in our [paper](https://arxiv.org/pdf/2106.06381.pdf).
|
| 6 |
+
|
| 7 |
+
## Example
|
| 8 |
+
|
| 9 |
+
```
|
| 10 |
+
model = = AutoModel.from_pretrained("CZWin32768/xlm-align")
|
| 11 |
+
```
|
| 12 |
+
|
| 13 |
+
## Evaluation Results
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
## MD5
|
| 17 |
+
|
| 18 |
+
```
|
| 19 |
+
b9d214025837250ede2f69c9385f812c config.json
|
| 20 |
+
6005db708eb4bab5b85fa3976b9db85b pytorch_model.bin
|
| 21 |
+
bf25eb5120ad92ef5c7d8596b5dc4046 sentencepiece.bpe.model
|
| 22 |
+
eedbd60a7268b9fc45981b849664f747 tokenizer.json
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
## About
|
| 26 |
+
|
| 27 |
+
Contact: chizewen\@outlook.com
|
| 28 |
+
|
| 29 |
+
BibTeX:
|
| 30 |
+
|
| 31 |
+
```
|
| 32 |
+
@article{xlmalign,
|
| 33 |
+
title={Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment},
|
| 34 |
+
author={Zewen Chi and Li Dong and Bo Zheng and Shaohan Huang and Xian-Ling Mao and Heyan Huang and Furu Wei},
|
| 35 |
+
journal={arXiv preprint arXiv:2106.06381},
|
| 36 |
+
year={2021}
|
| 37 |
+
}
|
| 38 |
+
```
|