Commit
•
bb7b3ba
1
Parent(s):
a0028d6
Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,9 @@ library_name: peft
|
|
| 3 |
---
|
| 4 |
## Training procedure
|
| 5 |
|
|
|
|
|
|
|
|
|
|
| 6 |
|
| 7 |
The following `bitsandbytes` quantization config was used during training:
|
| 8 |
- quant_method: bitsandbytes
|
|
|
|
| 3 |
---
|
| 4 |
## Training procedure
|
| 5 |
|
| 6 |
+
We decided to release an ARIA 7B model trained with mistral 7B instruct as base model. We adressed the language challenge with a dataset focused on french language.
|
| 7 |
+
|
| 8 |
+
The finetuning has been done with Nvidia GPUs.
|
| 9 |
|
| 10 |
The following `bitsandbytes` quantization config was used during training:
|
| 11 |
- quant_method: bitsandbytes
|