metadata

library_name: transformers
tags:
  - flow-merge
  - merge

qwen_merge_2

This model is the result of merge of the following models made with flow-merge:

Base model:
- Qwen/Qwen1.5-0.5B
Models:
- Qwen/Qwen1.5-0.5B-chat
- minghaowu/Qwen1.5-0.5B-OpenHermes-2.5

flow-merge config

The following configuration was used to merge the models:

base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: false
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./merged_model