Undi95/C-Based-2x7B-iMatrix-GGUF

Description

This repo contains GGUF files of C-Based-2x7B.

Created by taking the best benchmark scoring model with the smallest size on HF leaderboard as of today (29/03/2024) which is zhengr/MixTAO-7Bx2-MoE-v8.1 and merging to it some MoE done by myself using the human feedback data from Chaiverse specifically to have high level of RP, intelligence and usage.

Since this is a frankenmoe, I really don't know what the result will be leaderboard side, but what interest me is the human interaction realism anyway (for RP/ERP).

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{system prompt}

### Input:
{prompt}

### Response:
{output}

If you want to support me, you can here.