Quantized models
Collection
Select models helpfully quantized by others as well as myself
•
58 items
•
Updated
•
2
Llama-3-Luminurse-v0.2-OAS-8B-GGUF
This repo contains GGUF quants of Llama-3-Luminurse-v0.2-OAS-8B. For suggested sampler settings, refer to the model card of the original repo.
This model is a merge of pre-trained language models created using mergekit.
Luminurse is a merge based on Lumimaid, enhanced with a biomedical model, with a dash of TheSpice thrown in to improve formatting of text generation.
Built with Meta Llama 3.
Merge Details
Merge Method
This model was merged using the task arithmetic merge method using NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
slices:
- sources:
- model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
layer_range: [0,32]
- model: grimjim/llama-3-aaditya-OpenBioLLM-8B
layer_range: [0,32]
parameters:
weight: 0.2
- model: cgato/L3-TheSpice-8b-v0.8.3
layer_range: [0,32]
parameters:
weight: 0.04
merge_method: task_arithmetic
dtype: bfloat16
- Downloads last month
- 42
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for grimjim/Llama-3-Luminurse-v0.2-OAS-8B-GGUF
Base model
grimjim/Llama-3-Luminurse-v0.2-OAS-8B