Apple M3 Ultra: Specs & Local-AI Compatibility
Very large unified memory (up to ~512GB on Mac Studio) for flagship models.
Specs
- Memory
- 256 GB unified
- Memory type
- Unified LPDDR5
- Bandwidth
- 819 GB/s
- Approx FP16
- to verify
- Architecture
- Apple M3 Ultra
- Process
- TSMC N3B
- Power
- 90 W
- Launch
- 2025
Models this chip can run
Open models graded for a single Apple M3 Ultra, best fit first.
- Gemma 2 27BGemma · ~27B · 8K ctx · Gemma Terms of Use
Fits at FP16 (~54GB) with ~125.2GB headroom — about 3 concurrent instances.
FP16 · ~54GBRuns well - Gemma 3 27BGemma 3 · ~27B · 128K ctx · Gemma Terms of Use
Fits at FP16 (~54GB) with ~125.2GB headroom — about 3 concurrent instances.
FP16 · ~54GBRuns well - Mistral Small 24BMistral · ~24B · 32K ctx · Apache-2.0
Fits at FP16 (~48GB) with ~131.2GB headroom — about 3 concurrent instances.
FP16 · ~48GBRuns well - DeepSeek-Coder V2 (class)DeepSeek · ~16B · 128K ctx · DeepSeek License
Fits at FP16 (~33GB) with ~146.2GB headroom — about 5 concurrent instances.
FP16 · ~33GBRuns well - StarCoder2 15BStarCoder · ~15B · 16K ctx · BigCode OpenRAIL-M
Fits at FP16 (~30GB) with ~149.2GB headroom — about 5 concurrent instances.
FP16 · ~30GBRuns well - Qwen2.5 14BQwen · ~14B · 128K ctx · Apache-2.0
Fits at FP16 (~30GB) with ~149.2GB headroom — about 5 concurrent instances.
FP16 · ~30GBRuns well - Qwen3 14BQwen · ~14B · 128K ctx · Apache-2.0
Fits at FP16 (~30GB) with ~149.2GB headroom — about 5 concurrent instances.
FP16 · ~30GBRuns well - Phi-3 Medium (14B)Phi · ~14B · 128K ctx · MIT
Fits at FP16 (~28GB) with ~151.2GB headroom — about 6 concurrent instances.
FP16 · ~28GBRuns well
Devices built on this chip
Build a private AI Business OS on Apple M3 Ultra
Run your own AI agents on hardware you control — private by design, no per-seat data leaving your premises. BrainOutput helps you pick the right machine and turn it into a working AI Business OS.
Explore the AI Business OS