--- base_model: - elinas/Chronos-Gold-12B-1.0 - ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2 - nbeerbower/Mistral-Nemo-Prism-12B library_name: transformers tags: - mergekit - merge --- Model details: - ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/66c1cc08453a7ef6c5fe657a/obRjltZGWzWfiU-u-MMRL.webp) This is definately not perfect, but it does feel pretty close. Feedback is welcome, as always. --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [nbeerbower/Mistral-Nemo-Prism-12B](https://huggingface.co/nbeerbower/Mistral-Nemo-Prism-12B) as a base. ### Models Merged The following models were included in the merge: * [elinas/Chronos-Gold-12B-1.0](https://huggingface.co/elinas/Chronos-Gold-12B-1.0) * [ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: nbeerbower/Mistral-Nemo-Prism-12B #no parameters necessary for base model - model: ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2 parameters: density: 0.5 weight: 0.5 - model: elinas/Chronos-Gold-12B-1.0 parameters: density: 0.5 weight: 0.5 merge_method: ties base_model: nbeerbower/Mistral-Nemo-Prism-12B parameters: normalize: false int8_mask: true dtype: float16 ```