Collection by
4 days ago
4 days ago
Collections
Discover the best community collections!
Collections including paper arxiv:2411.04330
Collection by
6 days ago
6 days ago
Collection by
6 days ago
6 days ago
Collection by
5 days ago
5 days ago
-
KAN: Kolmogorov-Arnold Networks
Paper • 2404.19756 • Published • 108 -
The Platonic Representation Hypothesis
Paper • 2405.07987 • Published • 2 -
The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
Paper • 2304.05366 • Published • 1 -
Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
Paper • 1512.02479 • Published • 1
Collection by
4 days ago
4 days ago
-
STaR: Bootstrapping Reasoning With Reasoning
Paper • 2203.14465 • Published • 7 -
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Paper • 2401.06066 • Published • 43 -
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
Paper • 2405.04434 • Published • 13 -
Prompt Cache: Modular Attention Reuse for Low-Latency Inference
Paper • 2311.04934 • Published • 28
Collection by
6 days ago
6 days ago
-
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 45 -
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
Paper • 2407.11062 • Published • 8 -
Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models
Paper • 2407.12327 • Published • 77 -
BitNet a4.8: 4-bit Activations for 1-bit LLMs
Paper • 2411.04965 • Published • 63
Collection by
2 days ago
2 days ago
-
RLHF Workflow: From Reward Modeling to Online RLHF
Paper • 2405.07863 • Published • 67 -
Chameleon: Mixed-Modal Early-Fusion Foundation Models
Paper • 2405.09818 • Published • 126 -
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
Paper • 2405.15574 • Published • 53 -
An Introduction to Vision-Language Modeling
Paper • 2405.17247 • Published • 85
Collection by
3 days ago
3 days ago
-
SELF: Language-Driven Self-Evolution for Large Language Model
Paper • 2310.00533 • Published • 2 -
GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length
Paper • 2310.00576 • Published • 2 -
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
Paper • 2305.13169 • Published • 3 -
Transformers Can Achieve Length Generalization But Not Robustly
Paper • 2402.09371 • Published • 12