How to use tools in Ollama ?
#7
by
razvanab
- opened
How do I use tools in Ollama with this model?
On the model page, it says:
Optional tools template with quants with the prefix tools
but no additional information.
Here's the list of the tags:
https://ollama.com/mannix/llama3.1-8b-abliterated/tags
If you want to use the chat template:
ollama run mannix/llama3.1-8b-abliterated:q4_0
If you want to use the tools template:
https://ollama.com/mannix/llama3.1-8b-abliterated:tools-q4_0
Thank you