--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - openchat/openchat-3.5-1210 - Intel/neural-chat-7b-v3-3 - HuggingFaceH4/zephyr-7b-beta --- # Hannah-2 Hannah-2 is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [openchat/openchat-3.5-1210](https://huggingface.co/openchat/openchat-3.5-1210) * [Intel/neural-chat-7b-v3-3](https://huggingface.co/Intel/neural-chat-7b-v3-3) * [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) ## 🧩 Configuration ```yaml models: - model: mistralai/Mistral-7B-v0.1 # no parameters necessary for base model - model: openchat/openchat-3.5-1210 parameters: density: 0.53 weight: 0.4 - model: Intel/neural-chat-7b-v3-3 parameters: density: 0.53 weight: 0.25 - model: HuggingFaceH4/zephyr-7b-beta parameters: density: 0.53 weight: 0.35 merge_method: dare_ties base_model: mistralai/Mistral-7B-v0.1 parameters: normalize: true dtype: float16 ```