Skip to content
BYOK Tools

KoboldCpp

One-file local AI runner geared toward storytelling and roleplay.

4.1 editor score•Local AI•Free & open source

Overview

KoboldCpp is a single-executable local inference server built on llama.cpp with a bundled KoboldAI Lite interface. It is popular for story writing and pairs well with frontends like SillyTavern.

  • Single executable
  • Story and adventure modes
  • Image generation support
  • OpenAI and Kobold APIs

Our verdict

What we like

  • Easy local setup
  • Great for creative writing

Watch out for

  • Interface aimed at hobbyists

Works with these providers

Keys from these providers work in this app. Usage is billed by the provider at its list price.

BYOK Key Safety Score

Key handling in KoboldCpp

How we score
85/ 100

Grade A

Your key is stored on your device and requests go directly to the provider.

  • Key storage

    Key stays on your device; requests go direct to the provider.

    40/40
  • Auditable code

    Open source: anyone can verify how keys are handled.

    25/25
  • Self-hosting

    Runs as a local app, but not as a self-hosted service.

    8/15
  • Offline option

    Supports local models, so no key is needed at all for private work.

    10/10
  • Provider choice

    1 provider option, which lets you pick the provider whose data terms you trust.

    2/10

Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.

KoboldCpp FAQ

Does KoboldCpp support bring your own key?
Yes. KoboldCpp accepts your own API key from OpenAI-compatible. Usage is billed by the provider at its API rates.
Where does KoboldCpp store my API key?
On your device. Requests go directly from KoboldCpp to the provider. Its BYOK Tools Key Safety Score is 85/100.
Is KoboldCpp free?
Open source: Free & open source. API usage is billed separately by your model provider.
Is KoboldCpp open source?
Yes. The source code is at https://github.com/LostRuins/koboldcpp.
Can KoboldCpp run local models?
Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
Which platforms does KoboldCpp support?
macOS, Windows, Linux.

Community reviews

No reviews yet.