PrivateGPT
Production-ready API and UI for private document Q&A.
Overview
PrivateGPT from Zylon lets you ingest documents and ask questions with no data leaving your environment, using local models or chosen cloud backends. It exposes an OpenAI-style API for building apps.
- Document ingestion
- Private RAG
- OpenAI-compatible API
- Gradio UI
Our verdict
What we like
- Strong privacy story
- Developer-friendly API
Watch out for
- Setup is technical
Works with these providers
Keys from these providers work in this app. Usage is billed by the provider at its list price.
BYOK Key Safety Score
Key handling in PrivateGPT
Grade B
Your key is stored by the service (usually encrypted) and requests may route through its servers.
- Key storage18/40
Key is held by the vendor, so you rely on their security.
- Auditable code25/25
Open source: anyone can verify how keys are handled.
- Self-hosting15/15
Can run entirely on your own infrastructure.
- Offline option10/10
Supports local models, so no key is needed at all for private work.
- Provider choice8/10
4 provider options, which lets you pick the provider whose data terms you trust.
Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.
PrivateGPT FAQ
- Does PrivateGPT support bring your own key?
- Yes. PrivateGPT accepts your own API key from Ollama, OpenAI, Azure OpenAI and OpenAI-compatible. Usage is billed by the provider at its API rates.
- Where does PrivateGPT store my API key?
- On the vendor's servers, and requests may be routed through them. Its BYOK Tools Key Safety Score is 76/100.
- Is PrivateGPT free?
- Open source: Free & open source. API usage is billed separately by your model provider.
- Is PrivateGPT open source?
- Yes. The source code is at https://github.com/zylon-ai/private-gpt. It can also be self-hosted.
- Can PrivateGPT run local models?
- Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
- Which platforms does PrivateGPT support?
- Self-hosted, Web.
Community reviews
No reviews yet.
Alternatives to PrivateGPT
All notes & knowledge →AnythingLLM
Notes & Knowledge
All-in-one desktop and Docker app for private document chat and agents.
RAGFlow
Notes & Knowledge
Open-source RAG engine built on deep document understanding.
Onyx
Notes & Knowledge
Open-source enterprise search and AI assistant over your company tools.
Kotaemon
Notes & Knowledge
Clean open-source RAG UI for chatting with your documents.
Paperless-AI
Notes & Knowledge
Automatic tagging and document chat for Paperless-ngx using your LLM.
MaxKB
Notes & Knowledge
Open-source knowledge-base Q&A and agent platform.