README.md

metadata

license: apache-2.0
tags:
  - mlabonne/Marcoro14-7B-slerp
  - dpo
  - rlhf
  - mlx
datasets:
  - mlabonne/chatml_dpo_pairs
base_model: mlabonne/Marcoro14-7B-slerp

NeuralMarcoro14-7B-4bit

This model was converted to MLX format from mlabonne/NeuralMarcoro14-7B. Refer to the original model card for more details on the model.

Use with mlx

pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/NeuralMarcoro14-7B-4bit --prompt "My name is"