Hugging Face's logo

Kooten
/
Echidna-13b-v0.1-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
llama
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Description

Exllama 2 quant of NeverSleep/Echidna-13b-v0.1

8 BPW, Head bit set to 8

Prompt template: Alpaca 

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
Downloads last month
6
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Collection including Kooten/Echidna-13b-v0.1-8bpw-h8-exl2