O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
Paper
•
2411.16489
•
Published
•
26
Melisa Russak
melisa
AI & ML interests
I love definitions
Recent Activity
Organizations
melisa's activity
upvoted
a
paper
1 day ago
upvoted
a
paper
8 days ago
upvoted
an
article
9 days ago
Article
Fine-tuning LLMs with Singular Value Decomposition
By
•
•
8
upvoted
a
paper
12 days ago
upvoted
2
papers
28 days ago
upvoted
a
paper
about 1 month ago
upvoted
a
paper
about 2 months ago
upvoted
5
papers
3 months ago
Attention Heads of Large Language Models: A Survey
Paper
•
2409.03752
•
Published
•
88
ContextCite: Attributing Model Generation to Context
Paper
•
2409.00729
•
Published
•
13
Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming
Paper
•
2408.16725
•
Published
•
52
The Mamba in the Llama: Distilling and Accelerating Hybrid Models
Paper
•
2408.15237
•
Published
•
37
Writing in the Margins: Better Inference Pattern for Long Context Retrieval
Paper
•
2408.14906
•
Published
•
138
upvoted
an
article
3 months ago
Article
Using Writer Framework with Hugging Face Spaces
By
•
•
30
upvoted
a
paper
5 months ago
upvoted
4
papers
6 months ago
Block Transformer: Global-to-Local Language Modeling for Fast Inference
Paper
•
2406.02657
•
Published
•
37
Zamba: A Compact 7B SSM Hybrid Model
Paper
•
2405.16712
•
Published
•
22
An Introduction to Vision-Language Modeling
Paper
•
2405.17247
•
Published
•
86
Evolutionary Optimization of Model Merging Recipes
Paper
•
2403.13187
•
Published
•
50
upvoted
a
collection
6 months ago