Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mlx-community
/
Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX
like
5
Follow
MLX Community
2.58k
MLX
Safetensors
teknium/OpenHermes-2.5
English
mistral
Mistral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Use this model
45778af
Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX
/
tokenizer_config.json
Commit History
Upload folder using huggingface_hub
7d7e378
verified
skirano
commited on
Feb 21