localGPT
Chat with your documents privately using local models.
Overview
localGPT ingests PDFs and other documents into a local vector store and answers questions with models running through Ollama, so nothing leaves your machine. The newer version adds hybrid search and a web UI.
- Local ingestion
- Hybrid search
- Web UI
- Fully offline
Our verdict
What we like
- Privacy first
- Well known project
Watch out for
- Needs decent hardware
Works with these providers
Keys from these providers work in this app. Usage is billed by the provider at its list price.
BYOK Key Safety Score
Key handling in localGPT
Grade A
Your key is stored on your device and requests go directly to the provider.
- Key storage40/40
Key stays on your device; requests go direct to the provider.
- Auditable code25/25
Open source: anyone can verify how keys are handled.
- Self-hosting15/15
Can run entirely on your own infrastructure.
- Offline option10/10
Supports local models, so no key is needed at all for private work.
- Provider choice4/10
2 provider options, which lets you pick the provider whose data terms you trust.
Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.
localGPT FAQ
- Does localGPT support bring your own key?
- Yes. localGPT accepts your own API key from Ollama and OpenAI-compatible. Usage is billed by the provider at its API rates.
- Where does localGPT store my API key?
- On your device. Requests go directly from localGPT to the provider. Its BYOK Tools Key Safety Score is 94/100.
- Is localGPT free?
- Open source: Free & open source. API usage is billed separately by your model provider.
- Is localGPT open source?
- Yes. The source code is at https://github.com/PromtEngineer/localGPT. It can also be self-hosted.
- Can localGPT run local models?
- Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
- Which platforms does localGPT support?
- Self-hosted, Web.
Community reviews
No reviews yet.
Alternatives to localGPT
All notes & knowledge →AnythingLLM
Notes & Knowledge
All-in-one desktop and Docker app for private document chat and agents.
RAGFlow
Notes & Knowledge
Open-source RAG engine built on deep document understanding.
Karakeep
Notes & Knowledge
Self-hosted bookmark and note manager with AI tagging via OpenAI or Ollama.
Onyx
Notes & Knowledge
Open-source enterprise search and AI assistant over your company tools.
Linkwarden
Notes & Knowledge
Self-hosted collaborative bookmark manager with optional AI tagging.
Kotaemon
Notes & Knowledge
Clean open-source RAG UI for chatting with your documents.