File size: 614 Bytes
cc8ca3e
 
 
495523b
16f3dac
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
495523b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
---
license: apache-2.0
---

Frankenmerge 11b between HuggingFaceH4/zephyr-7b-beta and Intel/neural-chat-7b-v3-1

Merge with the following conditions (via mergekit on github)

- model: Intel/neural-chat-7b-v3-1
layer_range: [0, 8]

- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [4, 12]

- model: Intel/neural-chat-7b-v3-1
layer_range: [9, 16]

- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [13, 20]

- model: Intel/neural-chat-7b-v3-1
layer_range: [17, 24]

- model: HuggingFaceH4/zephyr-7b-beta
layer_range: [21, 28]

- model: Intel/neural-chat-7b-v3-1
layer_range: [25, 32]

merge_method: passthrough