Hugging Face's logo

lodrick-the-lafted
/
Kaiju-A-57B

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
2
Kaiju-A-57B / README.md
lodrick-the-lafted's picture
lodrick-the-lafted
Update README.md
11fc415 verified
preview code
|
raw
history blame contribute delete
902 Bytes
metadata
license: other
license_name: yi-34b
license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE

Kaiju-A-57B

I made this model as an experiment for /r/LocalLlama, who've all wanted a Yi graft like Goliath. I took the goliath-120B template and used the same proportions to blend Tess-M-v1.3 and Tess-M-v1.2. The mergekit yaml is in the repo. I chose these two as there are still precious few Yi-200K tunes and merging models with different ideas of positional encoding did not work well. Thanks to Meta for Llama which kickstarted open weight models, thanks to Yi for the base model, thanks migtissera and the others who have fine-tuned Yi. Special shoutout to chargoddard for mergekit and the original frankenllama.

Prompt Format: 

SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT: