Triangle104 commited on
Commit
593831a
1 Parent(s): f485160

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md CHANGED
@@ -109,6 +109,29 @@ model-index:
109
  This model was converted to GGUF format from [`nbeerbower/Hermes2-Gutenberg2-Mistral-7B`](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
110
  Refer to the [original model card](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) for more details on the model.
111
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
112
  ## Use with llama.cpp
113
  Install llama.cpp through brew (works on Mac and Linux)
114
 
 
109
  This model was converted to GGUF format from [`nbeerbower/Hermes2-Gutenberg2-Mistral-7B`](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
110
  Refer to the [original model card](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) for more details on the model.
111
 
112
+ ---
113
+ Model details:
114
+ -
115
+ Hermes2-Gutenberg2-Mistral-7B
116
+
117
+ NousResearch/Hermes-2-Pro-Mistral-7B finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
118
+ Method
119
+
120
+ ORPO tuned with 2x RTX 3090 for 3 epochs.
121
+ Open LLM Leaderboard Evaluation Results
122
+
123
+ Detailed results can be found here
124
+ Metric Value
125
+ Avg. 19.35
126
+ IFEval (0-Shot) 37.21
127
+ BBH (3-Shot) 28.91
128
+ MATH Lvl 5 (4-Shot) 5.66
129
+ GPQA (0-shot) 5.26
130
+ MuSR (0-shot) 16.92
131
+ MMLU-PRO (5-shot) 22.14
132
+
133
+ ---
134
+
135
  ## Use with llama.cpp
136
  Install llama.cpp through brew (works on Mac and Linux)
137