Skip to content
BYOK Tools

MLC Chat

Demo apps from MLC LLM that run open models natively on phones.

3.7 editor score•Mobile Apps•Free & open source

Overview

MLC Chat is the reference iOS and Android app from the MLC LLM project, compiling models like Llama, Qwen and Phi for on-device GPU inference. It downloads models once and runs them without a network.

  • On-device GPU inference
  • Prebuilt model list
  • Offline use
  • Cross-platform engine

Our verdict

What we like

  • Technically strong engine
  • Free

Watch out for

  • Basic chat UI

Works with these providers

Keys from these providers work in this app. Usage is billed by the provider at its list price.

BYOK Key Safety Score

Key handling in MLC Chat

How we score
77/ 100

Grade B

Your key is stored on your device and requests go directly to the provider.

  • Key storage

    Key stays on your device; requests go direct to the provider.

    40/40
  • Auditable code

    Open source: anyone can verify how keys are handled.

    25/25
  • Self-hosting

    Web-hosted by the vendor.

    0/15
  • Offline option

    Supports local models, so no key is needed at all for private work.

    10/10
  • Provider choice

    1 provider option, which lets you pick the provider whose data terms you trust.

    2/10

Whatever the score, give each app its own key, set a monthly spend limit with your provider, and revoke keys you no longer use. Read the key-safety checklist.

MLC Chat FAQ

Does MLC Chat support bring your own key?
Yes. MLC Chat accepts your own API key from OpenAI-compatible. Usage is billed by the provider at its API rates.
Where does MLC Chat store my API key?
On your device. Requests go directly from MLC Chat to the provider. Its BYOK Tools Key Safety Score is 77/100.
Is MLC Chat free?
Open source: Free & open source. API usage is billed separately by your model provider.
Is MLC Chat open source?
Yes. The source code is at https://github.com/mlc-ai/mlc-llm.
Can MLC Chat run local models?
Yes. It can connect to local runtimes such as Ollama or LM Studio, so no API key is needed for private or offline use.
Which platforms does MLC Chat support?
iOS, Android.

Community reviews

No reviews yet.