--- base_model: - IntervitensInc/Llama-3.2-3B-chatml - alpindale/Llama-3.2-3B-Instruct language: - en library_name: transformers pipeline_tag: text-generation tags: - merge - finetuned - llama - llama-3 license: llama3.2 inference: parameters: temperature: 0.2 widget: - messages: - role: user content: Any plans for a weekend? --- # intro music... This is... ## Llama Lo1 01 My first RP directed finetune and merge! Not as expresive like Llama Instruct might be. Writes simpler responses in chat. Somewhat broken as I did not figured how to deal properly with tokenizers. Trained on few datasets from [jeiku](https://huggingface.co/jeiku) - Thank you! Have fun!
### Settings - Kobold: use Chat Mode - SillyTawern: use ChatML for Context Template and Llama 3 Instruct for Instruct Mode - ChatterUI: use Llama 3 Instruct template - Set Temperature below 1 - You can easily overload this AI with too complicaded, long character cards. Keep things simple! ;P ### Quants - [ExLlamav2 8bpw](https://huggingface.co/altomek/Lo101-3B-AnD-8bpw-EXL2) - [ExLlamav2 measurments](https://huggingface.co/altomek/measurements/resolve/main/Lo101-3B-AnD_measurement.json) - [GGUF Q4_0](https://huggingface.co/altomek/Lo101-3B-AnD-GGUF/resolve/main/Lo101-3B-AnD-Q4_0.gguf) - [GGUF Q4_0_4_4](https://huggingface.co/altomek/Lo101-3B-AnD-GGUF/resolve/main/Lo101-3B-AnD-Q4_0_4_4.gguf) - [GGUF imatrix](https://huggingface.co/altomek/Lo101-3B-AnD-GGUF/resolve/main/Lo101-3B-AnD.imatrix)