mlabonne commited on
Commit
0831565
·
1 Parent(s): efb18b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -21,7 +21,7 @@ datasets:
21
 
22
  # NeuralHermes 2.5 - Mistral 7B
23
 
24
- NeuralHermes is an [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) model that has been further fine-tuned with Direct Preference Optimization (DPO) using the [mlabonne/chatml_dpo_pairs](https://huggingface.co/datasets/mlabonne/chatml_dpo_pairs) dataset. It surpasses the original model on several benchmarks (see results)
25
 
26
  It is directly inspired by the RLHF process described by [Intel/neural-chat-7b-v3-1](https://huggingface.co/Intel/neural-chat-7b-v3-1)'s authors to improve performance. I used the same dataset and reformatted it to apply the ChatML template.
27
 
@@ -29,8 +29,8 @@ The code to train this model is available on [Google Colab](https://colab.resear
29
 
30
  ### Quantized models
31
  * GGUF: https://huggingface.co/TheBloke/NeuralHermes-2.5-Mistral-7B-GGUF
32
- * EXL2: https://huggingface.co/IconicAI/NeuralHermes-2.5-Mistral-7B-exl2-5bpw
33
- * AWQ (5pbw): https://huggingface.co/TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ
34
 
35
  ## Results
36
 
 
21
 
22
  # NeuralHermes 2.5 - Mistral 7B
23
 
24
+ NeuralHermes is an [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) model that has been further fine-tuned with Direct Preference Optimization (DPO) using the [mlabonne/chatml_dpo_pairs](https://huggingface.co/datasets/mlabonne/chatml_dpo_pairs) dataset. It surpasses the original model on several benchmarks (see results).
25
 
26
  It is directly inspired by the RLHF process described by [Intel/neural-chat-7b-v3-1](https://huggingface.co/Intel/neural-chat-7b-v3-1)'s authors to improve performance. I used the same dataset and reformatted it to apply the ChatML template.
27
 
 
29
 
30
  ### Quantized models
31
  * GGUF: https://huggingface.co/TheBloke/NeuralHermes-2.5-Mistral-7B-GGUF
32
+ * AWQ: https://huggingface.co/TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ
33
+ * EXL2 (5pbw): https://huggingface.co/IconicAI/NeuralHermes-2.5-Mistral-7B-exl2-5bpw
34
 
35
  ## Results
36