File size: 2,681 Bytes
1c06907 288e226 1c06907 288e226 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 |
---
base_model:
- Sao10K/L3-Solana-8B-v1
- Masterjp123/Llama-3-SnowyRP-8B-V1
- kuotient/Meta-Llama-3-8B-Instruct
- cgato/L3-TheSpice-8b-v0.1.3
library_name: transformers
tags:
- mergekit
- merge
---
# merged
This is the unquantized Seccond version of SnowyRP using LLama3, added some models will add a EXL2 Quant.
[EXL2](https://huggingface.co/Masterjp123/Llama-3-SnowyRP-8B-V1-B-4.5bit)
## Merge Details
For this model I used the most uncensored and smartest finetunes of LLama 3, since LLama 3 has the largest ammount of training tokens I know of, so I expect it to have more than enough of a knowledge base.
This model is under both the LLama 3 licince and a few other ones that only affect conmerical uses, But I am not a lawer so use in commerical settings at your own risk.
## Model Use:
Here is an modified Alpaca prompt I use with this model:
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction: Take the role of {{char}} in a play that leaves a lasting impression on {{user}}. Write {{char}}'s next reply. Never skip or gloss over {{char}}’s actions. Progress the scene at a naturally slow pace. Avoid repetition, don't loop. Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions.
```
### Merge Method
This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [kuotient/Meta-Llama-3-8B-Instruct](https://huggingface.co/kuotient/Meta-Llama-3-8B-Instruct) as a base.
### Models Merged
The following models were included in the merge:
* [Sao10K/L3-Solana-8B-v1](https://huggingface.co/Sao10K/L3-Solana-8B-v1)
* [Masterjp123/Llama-3-SnowyRP-8B-V1](https://huggingface.co/Masterjp123/Llama-3-SnowyRP-8B-V1)
* [cgato/L3-TheSpice-8b-v0.1.3](https://huggingface.co/cgato/L3-TheSpice-8b-v0.1.3)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
base_model: kuotient/Meta-Llama-3-8B-Instruct
dtype: float16
merge_method: ties
parameters:
int8_mask: 1.0
normalize: 1.0
slices:
- sources:
- layer_range: [0, 32]
model: Masterjp123/Llama-3-SnowyRP-8B-V1
parameters:
density: [1.0, 0.7, 0.1]
weight: 1.0
- layer_range: [0, 32]
model: cgato/L3-TheSpice-8b-v0.1.3
parameters:
density: 0.5
weight: [0.0, 0.3, 0.7, 1.0]
- layer_range: [0, 32]
model: Sao10K/L3-Solana-8B-v1
parameters:
density: 0.33
weight:
- filter: mlp
value: 0.5
- value: 0.0
- layer_range: [0, 32]
model: kuotient/Meta-Llama-3-8B-Instruct
```
|