neuralmagic
/

Mistral-Nemo-Instruct-2407-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions Community

W8A8 for Mistral Nemo?

#1

by OwenArli - opened 19 days ago

19 days ago

Do I just change the scheme to scheme="W8A8"? No other changes needed?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment