Skip to content
BYOK Tools

19 tools

The best BYOK local ai

Run models on your own machine, mix in cloud keys when needed.

Top rated: Ollama, llama.cpp, LM Studio

19 tools

Ollama

Local AI

4.8

The simplest way to run open LLMs locally with one command.

Open sourceLocal modelsKey stays local

llama.cpp

Local AI

4.7

C and C++ LLM inference engine with a built-in server and web UI.

Open sourceLocal modelsKey stays local

LM Studio

Local AI

4.7

Desktop app to discover, download and run local LLMs.

FreeLocal modelsKey stays local

Jan

Local AI

4.6

Open-source ChatGPT alternative that runs 100% offline.

Open sourceLocal modelsKey stays local

LocalAI

Local AI

4.3

Self-hosted, drop-in OpenAI API replacement for local models.

Open sourceLocal models

GPT4All

Local AI

4.2

Private local chatbot from Nomic that runs on everyday hardware.

Open sourceLocal modelsKey stays local

Alpaca

Local AI

4.1

GNOME app for chatting with local Ollama models and remote providers.

Open sourceLocal modelsKey stays local

KoboldCpp

Local AI

4.1

One-file local AI runner geared toward storytelling and roleplay.

Open sourceLocal modelsKey stays local

Pinokio

Local AI

4.1

One-click installer and launcher for local AI apps.

Open sourceLocal modelsKey stays local

Text Generation WebUI

Local AI

4.1

Gradio web UI for running local LLMs with many backends.

Open sourceLocal modelsKey stays local

Harbor

Local AI

4.0

CLI that spins up full local LLM stacks with Docker in one command.

Open sourceLocal modelsKey stays local

llamafile

Local AI

4.0

Run an LLM from a single executable file on any OS.

Open sourceLocal modelsKey stays local

RecurseChat

Local AI

4.0

Mac app for local AI chat with RAG, plus optional cloud models via your keys.

One-time purchaseLocal modelsKey stays local

Hollama

Local AI

3.9

Minimal web UI for Ollama and OpenAI-compatible servers.

Open sourceLocal modelsKey stays local

Lemonade

Local AI

3.9

Local LLM server optimized for AMD Ryzen AI NPUs and GPUs.

Open sourceLocal modelsKey stays local

WebLLM Chat

Local AI

3.9

Chat with LLMs running entirely in your browser via WebGPU.

Open sourceLocal modelsKey stays local

Foundry Local

Local AI

3.8

Microsoft's on-device model runtime with an OpenAI-compatible endpoint.

FreeOpen sourceLocal modelsKey stays local

Ollamac

Local AI

3.8

Native macOS app for chatting with Ollama models.

Open sourceLocal modelsKey stays local

Sidekick

Local AI

3.8

Local-first Mac assistant with RAG over your files and optional cloud models.

Open sourceLocal modelsKey stays local

Related guides