kalo-team
/

llama3-4x8b-pythonT2_step_final

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

kalomaze commited on May 20

Commit

f4ccb00

•

1 Parent(s): 15be534

Create README.md

Files changed (1) hide show

README.md +2 -0

README.md ADDED Viewed

	@@ -0,0 +1,2 @@


1	+ lr = 2e-6, ~2.5 mil tokens of Python instruct data, all around ~7k tokens ish for each sample (300 total samples).
2	+ 1 epoch distillation of 70b logprobs, topk=200