Hugging Face's logo

michaelfeil
/
ct2fast-Llama-2-7b-chat-hf

Text Generation
Transformers
PyTorch
English
llama
ctranslate2
int8
float16
facebook
meta
llama-2
Model card Files Community
3
New discussion

Weird results with ct2fast-Llama-2-7b versus the unquantized Llama-2-7b
#3 opened about 1 year ago by thanhnew2001