LLMs quantized with GPTQ
Irina Proskurina
iproskurina
AI & ML interests
LLMs: quantization, pre-training
Recent Activity
authored
a paper
16 days ago
When Quantization Affects Confidence of Large Language Models?
updated
a collection
19 days ago
LMs + Topological Data Analysis🌌
updated
a collection
19 days ago
Quantized LLMs
Organizations
Collections
4
models
39
iproskurina/distilbert-base-alternate-layers
Updated
•
12
iproskurina/en_grammar_checker
Updated
•
34
•
4
iproskurina/Mistral-7B-v0.3-gptq-3bit
Text Generation
•
Updated
•
10
iproskurina/Mistral-7B-v0.3-GPTQ-8bit-g128
Text Generation
•
Updated
•
6
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g128
Text Generation
•
Updated
•
9
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g64
Text Generation
•
Updated
•
11
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g64
Text Generation
•
Updated
•
7
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g128
Text Generation
•
Updated
•
7
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g128
Text Generation
•
Updated
•
9
iproskurina/Mistral-7B-v0.1-GPTQ-4bit-g128
Text Generation
•
Updated
•
8