MNN Chat
Alibaba's Android app for fast on-device multimodal LLM inference.
Overview
MNN Chat is built on Alibaba's MNN inference engine and runs models such as Qwen, Llama and DeepSeek distills on Android CPUs with multimodal input. It is part of the open-source MNN repository.
- Fast CPU inference
- Image and audio input
- Model market
- Offline use
Our verdict
What we like
- Very fast on phones
- Backed by Alibaba
Watch out for
- Model catalog skews to Qwen
Works with these providers
Keys from these providers work in this app. Usage is billed by the provider at its list price.
BYOK Key Safety Score
Key handling in MNN Chat
Grade B
Your key is stored on your device and requests go directly to the provider.
- Key storage40/40
Key stays on your device; requests go direct to the provider.
- Auditable code25/25
Open source: anyone can verify how keys are handled.
- Self-hosting0/15
Web-hosted by the vendor.
- Offline option10/10
Supports local models, so no key is needed at all for private work.
- Provider choice2/10
1 provider option, which lets you pick the provider whose data terms you trust.
Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.
MNN Chat FAQ
- Does MNN Chat support bring your own key?
- Yes. MNN Chat accepts your own API key from OpenAI-compatible. Usage is billed by the provider at its API rates.
- Where does MNN Chat store my API key?
- On your device. Requests go directly from MNN Chat to the provider. Its BYOK Tools Key Safety Score is 77/100.
- Is MNN Chat free?
- Open source: Free & open source. API usage is billed separately by your model provider.
- Is MNN Chat open source?
- Yes. The source code is at https://github.com/alibaba/MNN.
- Can MNN Chat run local models?
- Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
- Which platforms does MNN Chat support?
- Android, iOS.
Community reviews
No reviews yet.
Alternatives to MNN Chat
All mobile apps →PocketPal AI
Mobile Apps
Run small language models on your phone, offline.
Kelivo
Mobile Apps
Flutter LLM chat client for iOS, Android and desktop with provider keys.
Google AI Edge Gallery
Mobile Apps
Google's app for running Gemma and other open models on device.
MLC Chat
Mobile Apps
Demo apps from MLC LLM that run open models natively on phones.
Pal Chat
Mobile Apps
iOS AI chat client that runs on your own API keys.
RikkaHub
Mobile Apps
Open-source Android LLM client for many providers with your own keys.