BEE-spoke-data/smol_llama-101M-GQA
Text Generation
•
Updated
•
3.99k
•
27
LLM training
small-scale pretraining experiments of mine
-
-
BEE-spoke-data/smol_llama-220M-GQA
Text Generation • Updated • 2.59k • 12
BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu
Text Generation • Updated • 49 • 1Note smol_llama-220M-GQA CPT on fineweb-edu for 10 billion tokens
-
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 1.56k • 6 -
BEE-spoke-data/mega-ar-126m-4k
Text Generation • Updated • 3.62k • 4 -
BEE-spoke-data/verysmol_llama-v11-KIx2
Text Generation • Updated • 1.47k • 4 -
pszemraj/pythia-31m-KI_v1-2048-scratch
Text Generation • Updated • 1.48k -
BEE-spoke-data/bert-plus-L8-4096-v1.0
Fill-Mask • Updated • 7 -
BEE-spoke-data/mega-encoder-small-16k-v1
Fill-Mask • Updated • 6 • 4
BEE-spoke-data/NanoLlama-GQA-L10-A32_KV8-v13-KI
Text Generation • Updated • 17 • 1Note this is a mid-training checkpoint of what is now smol_llama-220M
-
pszemraj/jamba-900M-v0.13-KIx2
Text Generation • Updated • 30 • 4