Hugging Face's logo

nbeerbower
/
Llama3.1-Allades-8B

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Llama3.1-Allades-8B / README.md
nbeerbower's picture
nbeerbower
Update README.md
a6ca474 verified
preview code
|
raw
history blame contribute delete
1.3 kB
metadata
library_name: transformers
license: llama3.1
datasets:
  - jondurbin/gutenberg-dpo-v0.1
  - nbeerbower/gutenberg2-dpo
  - jondurbin/truthy-dpo-v0.1
  - kyujinpy/orca_math_dpo
  - antiven0m/physical-reasoning-dpo
base_model:
  - mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated

image/png

Llama3.1-Allades-8B

Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writing, reasoning, and roleplay.

Datasets

Training

ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by Schneewolf Labs).

Data was prepared with Llama 3.1 Instruct.