mixture-of-gemmas-linear / mergekit_config.yml
johnsutor's picture
Upload folder using huggingface_hub
247cd23 verified
raw
history blame contribute delete
171 Bytes
models:
- model: google/gemma-7b
parameters:
weight: 1.0
- model: google/codegemma-7b
parameters:
weight: 0.3
merge_method: linear
dtype: bfloat16