Update README.md
Browse files
README.md
CHANGED
|
@@ -52,3 +52,6 @@ generated_ids = [
|
|
| 52 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
| 53 |
```
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
| 53 |
```
|
| 54 |
|
| 55 |
+
# Notes:
|
| 56 |
+
- Focus on o and ignore all linear layer
|
| 57 |
+
- Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1
|