Android LLM client architecture in 2026
A mobile-first architecture guide for Android LLM clients, covering local models, remote models, streaming UI, memory, privacy, cost, and failure modes.
Index · 03
Writing
Notes on Android, side projects that may or may not still exist, and whatever's currently frustrating me about AI tooling. Something personal now and then. No schedule.
Series
Start with a series
Design a spoken English practice app for mobile engineers
A system design pass for TalkLooper, a spoken English practice app: why the first MCP version was elegant, why transcript-only analysis broke down, and how I would redesign the loop around raw audio, consent, speech events, and practice feedback.
Design a daily sequence-memory game for mobile engineers
A mobile design pass for Prism: local-first play, daily seeds, Supabase leaderboards, cloud sync, streaks, notifications, and reliability tradeoffs.
Design Robinhood for mobile engineers
A Robinhood-style trading app from quotes and orders to fills, buying power, ledgers, compliance, and trust on mobile.
Design Slack client architecture for mobile engineers
The app-side version of the Slack design: state ownership, local storage, outbox, sync, navigation, accessibility, and reliable UX states.
Design PayPal for mobile engineers
A PayPal-style wallet from a mobile point of view: payment intents, ledgers, risk checks, idempotency, webhooks, local state, and recovery flows.
Design Slack for mobile engineers
Slack-style messaging through the mobile parts that get messy: offline sync, push notifications, local cache, read state, and failure handling.
Thinking through system design for mobile engineers
Notes on how I think about mobile systems, product behavior, and high-level architecture.
