--- base_model: - Qwen/Qwen2.5-Coder-7B - huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated - Etherll/Qwen2.5-Coder-7B-Instruct-Ties - MadeAgents/Hammer2.0-7b library_name: transformers tags: - mergekit - merge --- [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory) # QuantFactory/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.0-GGUF This is quantized version of [BenevolenceMessiah/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.0](https://huggingface.co/BenevolenceMessiah/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.0) created using llama.cpp # Original Model Card # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-Coder-7B](https://huggingface.co/Qwen/Qwen2.5-Coder-7B) as a base. ### Models Merged The following models were included in the merge: * [huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated](https://huggingface.co/huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated) * [Etherll/Qwen2.5-Coder-7B-Instruct-Ties](https://huggingface.co/Etherll/Qwen2.5-Coder-7B-Instruct-Ties) * [MadeAgents/Hammer2.0-7b](https://huggingface.co/MadeAgents/Hammer2.0-7b) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated architecture: qwen2 parameters: density: 1.0 weight: 1.0 - model: MadeAgents/Hammer2.0-7b architecture: qwen2 parameters: density: 1.0 weight: 1.0 - model: Etherll/Qwen2.5-Coder-7B-Instruct-Ties architecture: qwen2 parameters: density: 1.0 weight: 1.0 merge_method: ties base_model: Qwen/Qwen2.5-Coder-7B parameters: normalize: true int8_mask: false dtype: bfloat16 tokenizer_source: union ```