aaabiao commited on
Commit
3b9454c
1 Parent(s): 7c28961

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -27,6 +27,18 @@ For further information and related work, refer to our paper: ["OpenCodeInterpre
27
  ## Model Information
28
  This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
29
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ## Model Usage
31
  ### Inference
32
 
@@ -62,4 +74,7 @@ print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
62
  ## Contact
63
 
64
  If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
65
- We're here to assist you!"
 
 
 
 
27
  ## Model Information
28
  This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
29
 
30
+ ## Benchmark Scores
31
+
32
+ ### Single-turn Score:
33
+ | Benchmark | Score (Current) | Score (Previous) | Average Increase |
34
+ |--------------|-----------------|------------------|------------------|
35
+ | Humaneval(+) | 0.652 (0.61) | 0.634 (0.524) | 0.643 (0.567) |
36
+
37
+ ### Multi-turn Score:
38
+ | Benchmark | Score (Current) | Score (Previous) | Average Increase |
39
+ |--------------|-----------------|------------------|------------------|
40
+ | Humaneval(+) | 0.652 (0.622) | 0.652 (0.556) | 0.652 (0.589) |
41
+
42
  ## Model Usage
43
  ### Inference
44
 
 
74
  ## Contact
75
 
76
  If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
77
+ We're here to assist you!"
78
+
79
+
80
+