steerapi
/

TheBloke-Llama-2-7b-chat-fp16-w8-g128

Text Generation

Inference Endpoints

Model card Files Files and versions Community

TheBloke-Llama-2-7b-chat-fp16-w8-g128 / onnx

1 contributor

History: 5 commits

steerapi's picture

Upload folder using huggingface_hub

d786ec5 about 1 year ago

decoder_model_merged_quantized.onnx

331 MB
LFS

Upload folder using huggingface_hub about 1 year ago
decoder_model_merged_quantized.onnx_data

6.74 GB
LFS

Upload folder using huggingface_hub about 1 year ago
quantize_config.json

992 Bytes

Upload folder using huggingface_hub about 1 year ago