Gemma-2-9B-it-Advanced
Collection
Merges of the advanced research fine tunes of gemma-2 9B it
•
3 items
•
Updated
Note: A much-improved version is available at jsgreenawalt/gemma-2-9B-it-advanced-v2.1
Experimental merge #1, attempting to combine some of the advanced Gemma fine-tunes
Quants are available here: https://huggingface.co/QuantFactory/gemma-advanced-v1-GGUF
Notes and observations:
This is a merge of pre-trained language models created using mergekit.
This model was merged using the della merge method using google/google-gemma-2-9b-it as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: google/gemma-2-9b-it
# no parameters necessary for base model
- model: princeton-nlp/gemma-2-9b-it-SimPO
parameters:
density: 0.5
weight: 0.5
- model: wzhouad/gemma-2-9b-it-WPO-HB
parameters:
density: 0.5
weight: 0.5
merge_method: della
base_model: google/gemma-2-9b-it
parameters:
normalize: true
dtype: float16