Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Github

Discord

Request more models

medinote-7b - GGUF

Name Quant method Size
medinote-7b.Q2_K.gguf Q2_K 2.36GB
medinote-7b.IQ3_XS.gguf IQ3_XS 2.6GB
medinote-7b.IQ3_S.gguf IQ3_S 2.75GB
medinote-7b.Q3_K_S.gguf Q3_K_S 2.75GB
medinote-7b.IQ3_M.gguf IQ3_M 2.9GB
medinote-7b.Q3_K.gguf Q3_K 3.07GB
medinote-7b.Q3_K_M.gguf Q3_K_M 3.07GB
medinote-7b.Q3_K_L.gguf Q3_K_L 3.35GB
medinote-7b.IQ4_XS.gguf IQ4_XS 3.4GB
medinote-7b.Q4_0.gguf Q4_0 3.56GB
medinote-7b.IQ4_NL.gguf IQ4_NL 3.58GB
medinote-7b.Q4_K_S.gguf Q4_K_S 3.59GB
medinote-7b.Q4_K.gguf Q4_K 3.8GB
medinote-7b.Q4_K_M.gguf Q4_K_M 3.8GB
medinote-7b.Q4_1.gguf Q4_1 3.95GB
medinote-7b.Q5_0.gguf Q5_0 4.33GB
medinote-7b.Q5_K_S.gguf Q5_K_S 4.33GB
medinote-7b.Q5_K.gguf Q5_K 4.45GB
medinote-7b.Q5_K_M.gguf Q5_K_M 4.45GB
medinote-7b.Q5_1.gguf Q5_1 4.72GB
medinote-7b.Q6_K.gguf Q6_K 5.15GB
medinote-7b.Q8_0.gguf Q8_0 6.67GB

Original model description:

license: llama2 language: - en datasets: - AGBonnet/augmented-clinical-notes base_model: epfl-llm/meditron-7b

Model Card for MediNote-7B-v1.0

MediNote is a suite of open-source medical Large Language Models (LLMs) fine-tuned for clinical note generation from the Meditron foundation model. MediNote-7B is a 7 billion parameters model trained to generate clinical notes from doctor-patient conversations.

Model Details

Model pipeline

Uses

Direct Use

It is possible to use this model to generate clinical notes, which is useful for experimentation and understanding its capabilities. It should not be used directly for production or work that may impact people.

Out-of-Scope Use

This model is not yet robust enough for use in a real clinical setting. We do not recommend using this model for natural language generation in a production environment.

Downloads last month
161
GGUF
Model size
6.74B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .