--- base_model: - ND911/Fraken-Maid-TW-K-Slerp - ibm/merlinite-7b library_name: transformers tags: - mergekit - merge --- ![](maid.jpeg) # Franken-Merlinite-Maid 7B and 13B Slerp GGUF This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). # Compatible with ollama architectures: mistral Modelfile ``` FROM "./model/ND911_Fraken-Maid-TW-K-Slerp.gguf" TEMPLATE """ ### Instruction: {prompt} ### Response: """ ``` ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [ND911/Fraken-Maid-TW-K-Slerp](https://huggingface.co/ND911/Fraken-Maid-TW-K-Slerp) * [ibm/merlinite-7b](https://huggingface.co/ibm/merlinite-7b) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: ND911/Fraken-Maid-TW-K-Slerp layer_range: [0, 32] - model: ibm/merlinite-7b layer_range: [0, 32] merge_method: slerp base_model: ND911/Fraken-Maid-TW-K-Slerp parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: bfloat16 ```