Text of developer.apple.com › forums › thread › 845081 as Styx crawled it on Nov 19, 2026. The page may have changed since. Only its words are kept, without pictures or layout.

Open the live page

Exploring Apple Silicon + MLX for … | Apple Developer Forums

Exploring Apple Silicon + MLX for a persistent local AI companion architecture Machine Learning & AI Foundation Models Machine Learning You’re now watching this thread. If you’ve opted in to email or web notifications, you’ll be notified when there’s activity. Click again to stop watching or visit your profile to manage watched threads and notifications. You’ve stopped watching this thread and will no longer receive emails or web notifications when there’s activity.

Click again to start watching. isla-watson-project OP Created Sep ’26 Replies 2 Boosts 0 Views 519 Participants 3 I’m developing an independent project in Scotland called Isla Watson. The architecture is built around a simple principle: the model is replaceable; the identity is not. Long-term memory, persistent internal state and identity are designed to remain outside the foundation model, allowing local models to act as replaceable reasoning and language components without resetting the companion.

I’m now exploring whether Apple Silicon and MLX could provide the long-term local compute platform for the system — including specialist Mac nodes for reasoning, memory, speech and perception, with distributed inference when larger models are required. A particular area of interest is whether multiple Macs can be used in two complementary ways: as independent specialist agents during normal operation; and as a distributed MLX inference group when a larger model exceeds the capacity of one machine.

The first technical study I’d like to establish is a reproducible 1-node → 2-node baseline, measuring model capacity, unified-memory use, time to first token, generation throughput, power consumption, agent concurrency and distributed scaling efficiency. The wider research goal is to keep persistent identity and state independent from whichever foundation model is currently providing language and reasoning. I’d particularly value guidance from anyone working with MLX distributed inference, Thunderbolt/RDMA multi-Mac setups, or local agent architectures.

I’ve also posted an architecture-level overview in the MLX GitHub community and have a one-page public brief available for anyone interested in the wider design. https://github.com/ml-explore/mlx/discussions/4482 Replies 2 Boosts 0 Views 519 Participants 3 svgeek OP Sep ’26 Check out LocalLM Lab (locallmlab.dev) which I also post about here. It's a development tool for working & experimenting with local AI models.

If you a building AI-powered app on macOS, the companion SDK provides a lot of the lego pieces to do so. And example apps with source code are available for folks to use as a starting point. Add comment fushanjun OP Sep ’26 我已经研发成果并且,已经投入了实际的使用,目前我的记忆模型储存了大概2.8万条消息,完全部署在我的mac上,响应速度只要35毫秒,它可以完全不依赖llm进行记忆的存储 Add comment