Andyrasika
commited on
Commit
•
3e68c5a
1
Parent(s):
b00dc68
Update README.md
Browse files
README.md
CHANGED
@@ -63,6 +63,20 @@ The following hyperparameters were used during training:
|
|
63 |
| 1.77 | 1.6 | 88 | 1.8537 |
|
64 |
| 1.6501 | 2.0 | 110 | 1.8522 |
|
65 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
|
67 |
### Framework versions
|
68 |
|
|
|
63 |
| 1.77 | 1.6 | 88 | 1.8537 |
|
64 |
| 1.6501 | 2.0 | 110 | 1.8522 |
|
65 |
|
66 |
+
```
|
67 |
+
from peft import AutoPeftModelForCausalLM
|
68 |
+
|
69 |
+
trained_model = AutoPeftModelForCausalLM.from_pretrained(
|
70 |
+
"Andyrasika/fine-tuning-llama",
|
71 |
+
low_cpu_mem_usage=True,
|
72 |
+
)
|
73 |
+
|
74 |
+
merged_model = model.merge_and_unload()
|
75 |
+
merged_model.save_pretrained("merged_model", safe_serialization=True)
|
76 |
+
tokenizer.save_pretrained("merged_model")
|
77 |
+
```
|
78 |
+
|
79 |
+
|
80 |
|
81 |
### Framework versions
|
82 |
|