Update README.md
Browse files
README.md
CHANGED
|
@@ -118,10 +118,10 @@ Seed-Coder-8B-Base has been evaluated on code generation, code completion, and c
|
|
| 118 |
|
| 119 |
| | DeepSeek-Coder-6.7B-Base | OpenCoder-8B-Base | Qwen2.5-Coder-7B | Seed-Coder-8B-Base |
|
| 120 |
|------------|:------------------------:|:-----------------:|:----------------:|:------------------:|
|
| 121 |
-
| HumanEval | 47.6 | 66.5 | 72.0 | 77.4 |
|
| 122 |
-
| MBPP | 70.2 | 79.9 | 79.4 | 82.0 |
|
| 123 |
-
| MultiPL-E | 44.7 | 61.0 | 58.8 | 67.6 |
|
| 124 |
-
| cruxeval-O | 41.0 | 43.9 | 56.0 |
|
| 125 |
|
| 126 |
For detailed benchmark performance, please refer to our [📑 Technical Report](https://github.com/ByteDance-Seed/Seed-Coder/blob/master/Seed-Coder.pdf).
|
| 127 |
|
|
|
|
| 118 |
|
| 119 |
| | DeepSeek-Coder-6.7B-Base | OpenCoder-8B-Base | Qwen2.5-Coder-7B | Seed-Coder-8B-Base |
|
| 120 |
|------------|:------------------------:|:-----------------:|:----------------:|:------------------:|
|
| 121 |
+
| HumanEval | 47.6 | 66.5 | 72.0 | **77.4** |
|
| 122 |
+
| MBPP | 70.2 | 79.9 | 79.4 | **82.0** |
|
| 123 |
+
| MultiPL-E | 44.7 | 61.0 | 58.8 | **67.6** |
|
| 124 |
+
| cruxeval-O | 41.0 | 43.9 | **56.0** | 54.8 |
|
| 125 |
|
| 126 |
For detailed benchmark performance, please refer to our [📑 Technical Report](https://github.com/ByteDance-Seed/Seed-Coder/blob/master/Seed-Coder.pdf).
|
| 127 |
|