Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
RichardErkhov
/
sophosympatheia_-_Midnight-Miqu-70B-v1.5-4bits
like
0
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
arxiv:
2311.03099
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Can this be used on VLLM?
1
#1 opened 3 months ago by
xxxant