Florian Zimmermeister's picture

Florian Zimmermeister

flozi00

·

AI & ML interests

ASR, German LLM

Organizations

$A\\Ware's profile picture$

flozi00's activity

upvoted an article 17 days ago

Article

Releasing the largest multilingual open pretraining dataset

By

•

17 days ago

• 96

upvoted an article 22 days ago

Article

SauerkrautLM's Multi-Phase Spectrum Training: A Technical Deep Dive

By

•

22 days ago

• 9

upvoted a paper 25 days ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published 26 days ago • 45

upvoted an article about 1 month ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Sep 18

• 204

upvoted a paper about 2 months ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7 • 166

upvoted an article about 2 months ago

Article

Welcome, Gradio 5

Oct 9

• 74

upvoted 2 papers 2 months ago

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

Paper • 2407.10960 • Published Jul 15 • 11

Spectrum: Targeted Training on Signal to Noise Ratio

Paper • 2406.06623 • Published Jun 7 • 7

upvoted a collection 2 months ago

Strong German fp8 LLM's

Strong Large Language Models for the german language in fp8 format • 6 items • Updated Sep 24 • 3

upvoted 3 papers 2 months ago

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

Paper • 2405.03003 • Published May 5 • 7

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published Sep 18 • 136

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Paper • 2407.08296 • Published Jul 11 • 31

upvoted 2 collections 3 months ago

INT4 LLMs for vLLM

Accurate INT4 quantized models by Neural Magic, ready for use with vLLM! • 18 items • Updated Sep 26 • 8

FP8 LLMs for vLLM

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17 • 59

upvoted a collection 4 months ago

Research projects on top of vLLM

Papers cited in https://blog.vllm.ai/2024/07/25/lfai-perf.html • 6 items • Updated Jul 29 • 12

upvoted an article 5 months ago

Article

The Rise of Agentic Data Generation

By

•

Jul 15

• 78

upvoted an article 6 months ago

Article

Benchmarking Text Generation Inference

May 29

• 27

upvoted a collection 7 months ago

AQLM

AQLM quantized LLMs • 20 items • Updated May 3 • 44

upvoted an article 8 months ago

Article

Inference for PROs

Sep 22, 2023

• 51

upvoted a collection 8 months ago

DPO datasets for DE

A collection of DPO datasets for the DE language. • 6 items • Updated 10 days ago • 1