Finnish fine-tunes
Collection
All my Finnish fine-tuned models.
•
23 items
•
Updated
•
2
This is a merge of mpasila/Finnish-Chatty-Tiny-V1-1-33B.
Uses my tiny dataset to train this bigger variant of Viking model family.
This LoRA uses the 1000B checkpoint.
Trained for 1 epoch with 2048 token context, LoRA Rank 256, Alpha 512.
As a proof of concept it seems to work fairly well. Though I should generate the rest of the dataset which should hopefully work a lot better.
Uploaded model
- Developed by: mpasila
- License: apache-2.0
- Finetuned from model : LumiOpen/Viking-33B
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 7
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for mpasila/Finnish-Chatty-Tiny-V1-1-33B
Base model
LumiOpen/Viking-33B