Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
Paper
•
2411.11504
•
Published
•
19
LLM
-
-
Top-nσ: Not All Logits Are You Need
Paper • 2411.07641 • Published • 17 -
Adaptive Decoding via Latent Preference Optimization
Paper • 2411.09661 • Published • 10 -
When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
Paper • 2411.13476 • Published • 14 -
HuggingFaceTB/smoltalk
Viewer • Updated • 2.2M • 2.5k • 184 -
Hymba: A Hybrid-head Architecture for Small Language Models
Paper • 2411.13676 • Published • 37 -
TÜLU 3: Pushing Frontiers in Open Language Model Post-Training
Paper • 2411.15124 • Published • 54 -
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 41 -
O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
Paper • 2411.16489 • Published • 28 -
MH-MoE:Multi-Head Mixture-of-Experts
Paper • 2411.16205 • Published • 21 -
nGPT: Normalized Transformer with Representation Learning on the Hypersphere
Paper • 2410.01131 • Published • 9 -
O1-OPEN/OpenO1-SFT
Preview • Updated • 357 • 51 -
AI-MO/NuminaMath-CoT
Viewer • Updated • 860k • 2.48k • 248 -
GAIR/o1-journey
Viewer • Updated • 327 • 1.09k • 92 -
allenai/tulu-3-sft-mixture
Viewer • Updated • 939k • 1.53k • 53