--- language: - ko - en license: apache-2.0 tags: - text-generation - qwen2.5 - korean - instruct pipeline_tag: text-generation --- ## πŸ“Œ Notice - βœ… Original model is [beomi/Qwen2.5-7B-Instruct-kowiki-qa](https://huggingface.co/beomi/Qwen2.5-7B-Instruct-kowiki-qa) - βœ… Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp) ## πŸ’¬ Template ``` FROM Qwen2.5-7B-Instruct-kowiki-qa-Q8_0.gguf TEMPLATE """{{- if .System }} <|im_start|>system {{ .System }} <|im_end|> {{- end }} <|im_start|>user {{ .Prompt }} <|im_end|> <|im_start|>assistant """ SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄λ‘œ ν•΄μ£Όμ„Έμš”.""" PARAMETER temperature 0 PARAMETER num_ctx 128000 PARAMETER stop <|im_start|> PARAMETER stop <|im_end|> ``` ## πŸ§‘β€πŸ’» Helpful Contents - βœ… [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs) - βœ… [How to test llama3 by using Ollama](https://youtu.be/12CuUQIPdM4) - πŸ‡°πŸ‡· [LangChain Tutorial in Korean](https://wikidocs.net/book/14314) - πŸ”₯ Please subscribe and support on [YouTube](https://www.youtube.com/@teddynote)