stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A16
Text Generation
•
Updated
•
24
Edit Models filters
Active filters:
compressed-tensors
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W4A16
Text Generation
•
Updated
•
13
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W4A16
Text Generation
•
Updated
•
15
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8
Text Generation
•
Updated
•
15
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A16
Text Generation
•
Updated
•
15
Vikhrmodels/vikhr-nemo-12b-W8A8-gptq-jsoncal
Text Generation
•
Updated
•
64
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A8
Text Generation
•
Updated
•
8
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A16
Text Generation
•
Updated
•
8
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A8
Text Generation
•
Updated
•
8
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A16
Text Generation
•
Updated
•
8
thwin27/Molmo-7B-D-0924-FP8-Dynamic
Updated
•
2
yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
•
Updated
gmonair/Qwen2.5-Math-72B-Instruct-W4A16-padded
Updated
•
2
gmonair/Qwen2.5-Math-72B-Instruct-W8A16-padded
Updated
•
2
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8
Updated
stan-hua/Llama-3.1-8B-Instruct-LC-RTN-W4A16-KV4
Updated
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16-KV4
Updated
•
2
shadowlilac/reasoning-sparse
Updated
•
6
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16-KV8
Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w4a16-uncompressed
Updated