Mistral-RealworldQA-7b SFT GGUF

Original fp16 weights can be found here.

An experiment with the goal of reducing halucinations in VQA. First in of a series of projects centering around fine-tuning for image captioning.

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

GGUF

Model size

7.24B params

Architecture

llama

8-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for InferenceIllusionist/Mistral-RealworldQA-7b-SFT-GGUF

Base model

Quantized

this model