PEFT
Safetensors
Transformers
English
text-generation-inference
unsloth
mistral
trl
Not-For-All-Audiences
mpasila commited on
Commit
fb9fff1
1 Parent(s): 6d2866e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ datasets:
13
  - mpasila/PIPPA-ShareGPT-formatted-named
14
  - KaraKaraWitch/PIPPA-ShareGPT-formatted
15
  ---
16
- LoRA trained with Unsloth in 4-bit using [alpindale/Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf/) as the base model for 1 epoch. Dataset used with the LoRA is [pinzhenchen/alpaca-cleaned-fi](https://huggingface.co/datasets/pinzhenchen/alpaca-cleaned-fi/).
17
 
18
  Dataset used is [a modified](https://huggingface.co/datasets/mpasila/PIPPA-ShareGPT-formatted-named) version of [KaraKaraWitch/PIPPA-ShareGPT-formatted](https://huggingface.co/datasets/KaraKaraWitch/PIPPA-ShareGPT-formatted).
19
 
 
13
  - mpasila/PIPPA-ShareGPT-formatted-named
14
  - KaraKaraWitch/PIPPA-ShareGPT-formatted
15
  ---
16
+ LoRA trained in 4-bit with 8k context using [alpindale/Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf/) as the base model for 1 epoch. Dataset used with the LoRA is [pinzhenchen/alpaca-cleaned-fi](https://huggingface.co/datasets/pinzhenchen/alpaca-cleaned-fi/).
17
 
18
  Dataset used is [a modified](https://huggingface.co/datasets/mpasila/PIPPA-ShareGPT-formatted-named) version of [KaraKaraWitch/PIPPA-ShareGPT-formatted](https://huggingface.co/datasets/KaraKaraWitch/PIPPA-ShareGPT-formatted).
19