README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - unsloth/gemma-2b-bnb-4bit
  - TinyLlama/TinyLlama-1.1B-Chat-v1.0

Gemma-TinyLLama-Passthrough

Gemma-TinyLLama-Passthrough is a merge of the following models using mergekit:

• unsloth/gemma-2b-bnb-4bit
• TinyLlama/TinyLlama-1.1B-Chat-v1.0

🧩 Configuration

```yaml

slices:

• sources:
  • model: unsloth/gemma-2b-bnb-4bit layer_range: [0, 16]
• sources:
  • model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 layer_range: [6, 22] merge_method: passthrough dtype: bfloat16

```