PEFT
Safetensors
Transformers
English
text-generation-inference
unsloth
llama
trl
Not-For-All-Audiences
mpasila commited on
Commit
5074003
1 Parent(s): dd0a8ad

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -19,6 +19,8 @@ LoRA trained in 4-bit with 8k context using [meta-llama/Meta-Llama-3-8B](https:/
19
 
20
  Dataset used is [mpasila/LimaRP-PIPPA-Mix-8K-Context](https://huggingface.co/datasets/mpasila/LimaRP-PIPPA-Mix-8K-Context) which was made using [grimulkan/LimaRP-augmented](https://huggingface.co/datasets/grimulkan/LimaRP-augmented) and [KaraKaraWitch/PIPPA-ShareGPT-formatted](https://huggingface.co/datasets/KaraKaraWitch/PIPPA-ShareGPT-formatted).
21
 
 
 
22
  ### Prompt format: Llama 3 Instruct
23
 
24
  Unsloth changed assistant to gpt and user to human.
 
19
 
20
  Dataset used is [mpasila/LimaRP-PIPPA-Mix-8K-Context](https://huggingface.co/datasets/mpasila/LimaRP-PIPPA-Mix-8K-Context) which was made using [grimulkan/LimaRP-augmented](https://huggingface.co/datasets/grimulkan/LimaRP-augmented) and [KaraKaraWitch/PIPPA-ShareGPT-formatted](https://huggingface.co/datasets/KaraKaraWitch/PIPPA-ShareGPT-formatted).
21
 
22
+ This has been trained on the base model and not the instruct model. The model trained with the instruct model using the same dataset is here: [mpasila/Llama-3-Instruct-LiPPA-LoRA-8B](https://huggingface.co/mpasila/Llama-3-Instruct-LiPPA-LoRA-8B)
23
+
24
  ### Prompt format: Llama 3 Instruct
25
 
26
  Unsloth changed assistant to gpt and user to human.