Spaces:
Running
on
Zero
Running
on
Zero
File size: 1,257 Bytes
886d8e9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
title: Ollama
---
Ollama is an easy way to get local language models running on your computer through a command-line interface.
To run Ollama with Open interpreter:
1. Download Ollama for your platform from [here](https://ollama.ai/download).
2. Open the installed Ollama application, and go through the setup, which will require your password.
3. Now you are ready to download a model. You can view all available models [here](https://ollama.ai/library). To download a model, run:
```bash
ollama run <model-name>
```
4. It will likely take a while to download, but once it does, we are ready to use it with Open Interpreter. You can either run `interpreter --local` to set it up interactively in the terminal, or do it manually:
<CodeGroup>
```bash Terminal
interpreter --model ollama/<model-name>
```
```python Python
from interpreter import interpreter
interpreter.offline = True # Disables online features like Open Procedures
interpreter.llm.model = "ollama_chat/<model-name>"
interpreter.llm.api_base = "http://localhost:11434"
interpreter.chat()
```
</CodeGroup>
For any future runs with Ollama, ensure that the Ollama server is running. If using the desktop application, you can check to see if the Ollama menu bar item is active.
|