biomistral_ties

This model is the result of merge of the following models made with flow-merge:

  • Base model:
    • mistralai/Mistral-7B-Instruct-v0.1
  • Models:
    • BioMistral/BioMistral-Safetensors

flow-merge config

The following configuration was used to merge the models:

base_model: mistralai/Mistral-7B-Instruct-v0.1
models:
- path_or_id: mistralai/Mistral-7B-Instruct-v0.1
  weight: 0.5
- path_or_id: BioMistral/BioMistral-Safetensors
  weight: 0.5
method: ties-merging
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: true
  top_k: 0.7
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./biomistral_ties
hf_hub_settings:
  trust_remote_code: false
Downloads last month
6
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.