Llama3-70B-Fusion-ChatQA-Chinese
Llama3-70B-Fusion-ChatQA-Chinese is a merge of the following models using mergekit:
Configuration
```yaml models:
- model: meta-llama/Meta-Llama-3-70B
- model: shenzhi-wang/Llama3-70B-Chinese-Chat parameters: density: 0.5 weight: 0.6
- model: nvidia/Llama3-ChatQA-1.5-70B parameters: density: 0.5 weight: 0.4 merge_method: dare_ties base_model: meta-llama/Meta-Llama-3-70B parameters: int8_mask: true dtype: bfloat16 ```
- Downloads last month
- 12
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.