Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
torchao
Misc with no match
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
4-bit precision
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
29
Full-text search
Edit filters
Sort: Trending
Active filters:
torchao
Clear all
jerryzh168/llama3-int4wo-128
Updated
Sep 13
medmekk/Meta-Llama-3-8B-quantized-int8_weight_only
Updated
Oct 8
•
4
medmekk/Meta-Llama-3-8B-quantized-int8_dynamic_activation_int8_weight
Updated
Oct 8
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only
Updated
Oct 8
•
2
medmekk/Meta-Llama-3-8B-quantized-int8_weight_only-2
Updated
Oct 8
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only-2
Updated
Oct 8
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-64
Updated
Oct 8
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-32
Updated
Oct 8
•
4
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_256
Updated
Oct 8
medmekk/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
Oct 9
•
22
medmekk/Meta-Llama-3-8B-torchao-int8_dynamic_activation_int8_weight
Updated
Oct 8
medmekk/gpt2-torchao-int8_weight_only
Updated
Oct 8
•
2
medmekk/Llama-3.1-70B-torchao-int8_weight_only
Updated
Oct 8
•
2
medmekk/new_model
Updated
27 days ago
•
4
medmekk/qsdf
Updated
26 days ago
•
5
medmekk/new_gpt2
Updated
26 days ago
•
4
medmekk/an_other_torchao
Updated
26 days ago
•
4
medmekk/an_other_torchao_dynamic
Updated
26 days ago
•
4
marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
26 days ago
•
4
medmekk/new_tesing_model
Updated
22 days ago
•
4
medmekk/testing_int4
Updated
22 days ago
•
4
medmekk/quantized_int8_2
Updated
22 days ago
•
3
medmekk/quantized_int4
Updated
22 days ago
•
5
medmekk/quantized_70B
Updated
22 days ago
•
5
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_128
Updated
22 days ago
•
6
medmekk/custom_name
Updated
22 days ago
•
2
medmekk/custom_name_1
Updated
22 days ago
•
4
medmekk/deepseek-coder-1.3b-base-torchao-int8_weight_only
Updated
22 days ago
•
6
medmekk/testing_repo_name
Updated
22 days ago
•
4