5 guides
How-to
Step-by-step guides with copyable commands, expected output and a troubleshooting section. Every command comes from the tool's official docs, and each guide says exactly what we have and haven't run ourselves.
Start with the tested CPU generation demo: a 61 MB model, a terminal, and no GPU. The Ollama, browser chat, coding and document workflows disclose their separate testing limits.
5 of 5 guides
Run your first local model with Ollama and Open WebUI
Install Ollama, download a model that fits your machine, chat with it in the terminal, then put a ChatGPT-style web interface on top with Open WebUI.
Linux · macOS · Windows
Build llama.cpp and run a model with GPU offload
Compile llama.cpp from source with CUDA, download a GGUF straight from Hugging Face, and control how many layers go to the graphics card so models bigger than your VRAM still run.
Linux · Windows
Connect a local model to a coding agent (Aider + Ollama)
Pair-program in your terminal with a model running on your own machine. Aider edits files in your git repository and commits each change; Ollama serves the model.
Linux · macOS · Windows
Set up private document search (RAG) with Ollama and Open WebUI
Ask questions about your own PDFs and notes with a model that never leaves your machine. Uses a local embedding model, an Open WebUI knowledge base, and a chat model with enough context to read what it finds.
Linux · macOS · Windows
Run a tiny local model on your Mac CPU
Compile one small program, download a 61 MB model, and generate a story locally. A setup check with no GPU, account or API key.
macOS