19 tools
Ollama
Local AI
The simplest way to run open LLMs locally with one command.
llama.cpp
Local AI
C and C++ LLM inference engine with a built-in server and web UI.
LM Studio
Local AI
Desktop app to discover, download and run local LLMs.
Jan
Local AI
Open-source ChatGPT alternative that runs 100% offline.
LocalAI
Local AI
Self-hosted, drop-in OpenAI API replacement for local models.
GPT4All
Local AI
Private local chatbot from Nomic that runs on everyday hardware.
Alpaca
Local AI
GNOME app for chatting with local Ollama models and remote providers.
KoboldCpp
Local AI
One-file local AI runner geared toward storytelling and roleplay.
Pinokio
Local AI
One-click installer and launcher for local AI apps.
Text Generation WebUI
Local AI
Gradio web UI for running local LLMs with many backends.
Harbor
Local AI
CLI that spins up full local LLM stacks with Docker in one command.
llamafile
Local AI
Run an LLM from a single executable file on any OS.
RecurseChat
Local AI
Mac app for local AI chat with RAG, plus optional cloud models via your keys.
Hollama
Local AI
Minimal web UI for Ollama and OpenAI-compatible servers.
Lemonade
Local AI
Local LLM server optimized for AMD Ryzen AI NPUs and GPUs.
WebLLM Chat
Local AI
Chat with LLMs running entirely in your browser via WebGPU.
Foundry Local
Local AI
Microsoft's on-device model runtime with an OpenAI-compatible endpoint.
Ollamac
Local AI
Native macOS app for chatting with Ollama models.
Sidekick
Local AI
Local-first Mac assistant with RAG over your files and optional cloud models.