Skip to content
BYOK Tools

Text Generation WebUI

Gradio web UI for running local LLMs with many backends.

4.1 editor score•Local AI•Free & open source

Overview

Often called oobabooga, Text Generation WebUI is a long-standing open-source interface for loading local models through llama.cpp, ExLlama, Transformers and more. It exposes an OpenAI-compatible API and supports extensions.

  • Many model loaders
  • Extensions
  • OpenAI-compatible API
  • Character chat

Our verdict

What we like

  • Maximum control over local inference
  • Large community

Watch out for

  • Technical setup
  • Dated interface

Works with these providers

Keys from these providers work in this app. Usage is billed by the provider at its list price.

BYOK Key Safety Score

Key handling in Text Generation WebUI

How we score
92/ 100

Grade A

Your key is stored on your device and requests go directly to the provider.

  • Key storage

    Key stays on your device; requests go direct to the provider.

    40/40
  • Auditable code

    Open source: anyone can verify how keys are handled.

    25/25
  • Self-hosting

    Can run entirely on your own infrastructure.

    15/15
  • Offline option

    Supports local models, so no key is needed at all for private work.

    10/10
  • Provider choice

    1 provider option, which lets you pick the provider whose data terms you trust.

    2/10

Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.

Text Generation WebUI FAQ

Does Text Generation WebUI support bring your own key?
Yes. Text Generation WebUI accepts your own API key from OpenAI-compatible. Usage is billed by the provider at its API rates.
Where does Text Generation WebUI store my API key?
On your device. Requests go directly from Text Generation WebUI to the provider. Its BYOK Tools Key Safety Score is 92/100.
Is Text Generation WebUI free?
Open source: Free & open source. API usage is billed separately by your model provider.
Is Text Generation WebUI open source?
Yes. The source code is at https://github.com/oobabooga/text-generation-webui. It can also be self-hosted.
Can Text Generation WebUI run local models?
Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
Which platforms does Text Generation WebUI support?
Web, Self-hosted, macOS, Windows, Linux.

Community reviews

No reviews yet.