Update README.md
Browse files
README.md
CHANGED
@@ -27,6 +27,18 @@ For further information and related work, refer to our paper: ["OpenCodeInterpre
|
|
27 |
## Model Information
|
28 |
This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
|
29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
30 |
## Model Usage
|
31 |
### Inference
|
32 |
|
@@ -62,4 +74,7 @@ print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
|
|
62 |
## Contact
|
63 |
|
64 |
If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
|
65 |
-
We're here to assist you!"
|
|
|
|
|
|
|
|
27 |
## Model Information
|
28 |
This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
|
29 |
|
30 |
+
## Benchmark Scores
|
31 |
+
|
32 |
+
### Single-turn Score:
|
33 |
+
| Benchmark | Score (Current) | Score (Previous) | Average Increase |
|
34 |
+
|--------------|-----------------|------------------|------------------|
|
35 |
+
| Humaneval(+) | 0.652 (0.61) | 0.634 (0.524) | 0.643 (0.567) |
|
36 |
+
|
37 |
+
### Multi-turn Score:
|
38 |
+
| Benchmark | Score (Current) | Score (Previous) | Average Increase |
|
39 |
+
|--------------|-----------------|------------------|------------------|
|
40 |
+
| Humaneval(+) | 0.652 (0.622) | 0.652 (0.556) | 0.652 (0.589) |
|
41 |
+
|
42 |
## Model Usage
|
43 |
### Inference
|
44 |
|
|
|
74 |
## Contact
|
75 |
|
76 |
If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
|
77 |
+
We're here to assist you!"
|
78 |
+
|
79 |
+
|
80 |
+
|