LLM Pruning and Distillation in Practice: The Minitron Approach
Paper
•
2408.11796
•
Published
•
55
readings
-
-
TableBench: A Comprehensive and Complex Benchmark for Table Question Answering
Paper • 2408.09174 • Published • 51 -
To Code, or Not To Code? Exploring Impact of Code in Pre-training
Paper • 2408.10914 • Published • 41 -
Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications
Paper • 2408.11878 • Published • 51 -
Law of Vision Representation in MLLMs
Paper • 2408.16357 • Published • 92 -
CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
Paper • 2408.14572 • Published • 7 -
SciLitLLM: How to Adapt LLMs for Scientific Literature Understanding
Paper • 2408.15545 • Published • 34 -
LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
Paper • 2409.02889 • Published • 54 -
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA
Paper • 2409.02897 • Published • 44 -
Attention Heads of Large Language Models: A Survey
Paper • 2409.03752 • Published • 88 -
Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing
Paper • 2409.01322 • Published • 94 -
Towards a Unified View of Preference Learning for Large Language Models: A Survey
Paper • 2409.02795 • Published • 72 -
Paper Copilot: A Self-Evolving and Efficient LLM System for Personalized Academic Assistance
Paper • 2409.04593 • Published • 23 -
ProteinBench: A Holistic Evaluation of Protein Foundation Models
Paper • 2409.06744 • Published • 6 -
Qwen2.5-Coder Technical Report
Paper • 2409.12186 • Published • 136 -
Training Language Models to Self-Correct via Reinforcement Learning
Paper • 2409.12917 • Published • 135 -
HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models
Paper • 2409.16191 • Published • 41 -
Making Text Embedders Few-Shot Learners
Paper • 2409.15700 • Published • 29 -
Instruction Following without Instruction Tuning
Paper • 2409.14254 • Published • 27 -
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper • 2410.00531 • Published • 29 -
From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging
Paper • 2410.01215 • Published • 30 -
Not All LLM Reasoners Are Created Equal
Paper • 2410.01748 • Published • 27 -
RATIONALYST: Pre-training Process-Supervision for Improving Reasoning
Paper • 2410.01044 • Published • 34 -
Training Language Models on Synthetic Edit Sequences Improves Code Synthesis
Paper • 2410.02749 • Published • 12 -
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Paper • 2410.02367 • Published • 47 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 144 -
Selective Attention Improves Transformer
Paper • 2410.02703 • Published • 23 -
Agent S: An Open Agentic Framework that Uses Computers Like a Human
Paper • 2410.08164 • Published • 24 -
Toward General Instruction-Following Alignment for Retrieval-Augmented Generation
Paper • 2410.09584 • Published • 45 -
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models
Paper • 2410.13841 • Published • 14 -
HumanEval-V: Evaluating Visual Understanding and Reasoning Abilities of Large Multimodal Models Through Coding Tasks
Paper • 2410.12381 • Published • 42 -
Revealing the Barriers of Language Agents in Planning
Paper • 2410.12409 • Published • 23 -
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss
Paper • 2410.17243 • Published • 88 -
Why Does the Effective Context Length of LLMs Fall Short?
Paper • 2410.18745 • Published • 16 -
Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Dataset
Paper • 2410.22325 • Published • 9 -
A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
Paper • 2410.22391 • Published • 21 -
Both Text and Images Leaked! A Systematic Analysis of Multimodal LLM Data Contamination
Paper • 2411.03823 • Published • 43 -
Large Language Models Orchestrating Structured Reasoning Achieve Kaggle Grandmaster Level
Paper • 2411.03562 • Published • 60 -
HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systems
Paper • 2411.02959 • Published • 64 -
Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNets
Paper • 2305.17010 • Published -
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models
Paper • 2411.04905 • Published • 109 -
Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study
Paper • 2411.02462 • Published • 9 -
Large Language Models Can Self-Improve in Long-context Reasoning
Paper • 2411.08147 • Published • 59 -
Cut Your Losses in Large-Vocabulary Language Models
Paper • 2411.09009 • Published • 40 -
ClinicalBench: Can LLMs Beat Traditional ML Models in Clinical Prediction?
Paper • 2411.06469 • Published • 17 -
SlimLM: An Efficient Small Language Model for On-Device Document Assistance
Paper • 2411.09944 • Published • 12 -
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper • 2411.10958 • Published • 47 -
Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization
Paper • 2411.10442 • Published • 61 -
Hymba: A Hybrid-head Architecture for Small Language Models
Paper • 2411.13676 • Published • 37 -
Natural Language Reinforcement Learning
Paper • 2411.14251 • Published • 25 -
Cautious Optimizers: Improving Training with One Line of Code
Paper • 2411.16085 • Published • 13 -
Predicting Emergent Capabilities by Finetuning
Paper • 2411.16035 • Published • 6 -
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 41