Hugging Face's logo

mpasila
/
mistral-7b-v0.1-layla-v4-exl2-4bpw

Text Generation
Transformers
English
mistral
Inference Endpoints
Model card Files Community
Edit model card

This is an ExLlamaV2 quantized model in 4bpw of l3utterfly/mistral-7b-v0.1-layla-v4 using the default calibration dataset.

Original Model card:

Model Card

Model Description

Mistral 7B fine-tuned by the OpenHermes 2.5 dataset optimised for multi-turn conversation and character impersonation.

The dataset has been pre-processed by doing the following:

  1. remove all refusals
  2. remove any mention of AI assistant
  3. split any multi-turn dialog generated in the dataset into multi-turn conversations records
  4. added nfsw generated conversations from the Teatime dataset
  • Developed by: l3utterfly
  • Funded by: Layla Network
  • Model type: Mistral
  • Language(s) (NLP): English
  • License: Apache-2.0
  • Finetuned from model: Mistral 7B

Uses

Base model used by Layla - the offline personal assistant: https://www.layla-network.ai

Help & support: https://discord.gg/x546YJ6nYC

Prompt:

USER:
ASSISTANT:

Built with Axolotl

Downloads last month
19
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including mpasila/mistral-7b-v0.1-layla-v4-exl2-4bpw