andreabac3
commited on
Commit
•
c84a990
1
Parent(s):
2c91a87
Update README.md
Browse files
README.md
CHANGED
@@ -31,9 +31,11 @@ We started with a model called Baize, named after a legendary creature from Chin
|
|
31 |
## 🔎 Model's details
|
32 |
Fauno is a fine-tuned version of the LoRa weights of [Baize](https://github.com/project-baize/baize-chatbot), that is an improved version of [LLama](https://github.com/facebookresearch/llama).
|
33 |
|
34 |
-
We translated and cleaned the data of Baize, and then we fine-tuned the 7b
|
35 |
|
36 |
-
|
|
|
|
|
37 |
|
38 |
## Model initialization
|
39 |
```python
|
|
|
31 |
## 🔎 Model's details
|
32 |
Fauno is a fine-tuned version of the LoRa weights of [Baize](https://github.com/project-baize/baize-chatbot), that is an improved version of [LLama](https://github.com/facebookresearch/llama).
|
33 |
|
34 |
+
We translated and cleaned the data of Baize, and then we fine-tuned the 7b model using a single RTX A6000 (48GB of VRAM) with 19 hours for one epoch.
|
35 |
|
36 |
+
- 7B: https://huggingface.co/andreabac3/Fauno-Italian-LLM-7B
|
37 |
+
|
38 |
+
Fauno 30B and 65B are coming soon!
|
39 |
|
40 |
## Model initialization
|
41 |
```python
|