Guoheng Sun

s1ghhh's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 9 days ago

LLM-Drop

Collection

Model weights of paper "What Matters in Transformers? Not All Attention is Needed" (https://arxiv.org/abs/2406.15786) • 14 items • Updated 15 days ago • 3

upvoted a paper 23 days ago

What Matters in Transformers? Not All Attention is Needed

Paper • 2406.15786 • Published Jun 22 • 27

upvoted a collection about 2 months ago

🪐 SmolLM

Collection

A series of smol LLMs: 135M, 360M and 1.7B. We release base and Instruct models as well as the training corpus and some WebGPU demos • 12 items • Updated Aug 18 • 189