unsloth
/

Phi-3-mini-4k-instruct-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

TGI - RuntimeError: mat1 and mat2 shapes cannot be multiplied (4145x3072 and 1x14155776)

#3 opened 5 months ago by

No package metadata was found for bitsandbytes

#1 opened 6 months ago by