AMD Instinct MI210 64GB: Specs & Local-AI Compatibility
64GB HBM datacenter accelerator for AI/HPC.
Specs
- Memory
- 64 GB
- Memory type
- HBM2e
- Bandwidth
- 1,638 GB/s
- Approx FP16
- 181 TFLOPS
- Architecture
- CDNA 2
- Process
- TSMC 6nm
- Power
- 300 W
- Launch
- 2022
Models this chip can run
Open models graded for a single AMD Instinct MI210 64GB, best fit first.
- Qwen2.5 72BQwen · ~72B · 128K ctx · Qwen License
Fits at Q4_K_M (~44GB) with ~12.3GB headroom — about 1 concurrent instance.
Q4_K_M · ~44GBRuns well - Llama 3.1 70BLlama · ~70B · 128K ctx · Llama Community License
Fits at Q4_K_M (~42GB) with ~14.3GB headroom — about 1 concurrent instance.
Q4_K_M · ~42GBRuns well - Llama 3.3 70BLlama · ~70B · 128K ctx · Llama Community License
Fits at Q4_K_M (~42GB) with ~14.3GB headroom — about 1 concurrent instance.
Q4_K_M · ~42GBRuns well - DeepSeek-R1 Distill Llama 70BDeepSeek · ~70B · 128K ctx · MIT
Fits at Q4_K_M (~42GB) with ~14.3GB headroom — about 1 concurrent instance.
Q4_K_M · ~42GBRuns well - Mixtral 8x7B (MoE)Mistral · ~47B · 32K ctx · Apache-2.0
Fits at Q8_0 (~50GB) with ~6.3GB headroom — about 1 concurrent instance.
Q8_0 · ~50GBRuns well - CodeLlama 34BCodeLlama · ~34B · 16K ctx · Llama Community License
Fits at Q8_0 (~37GB) with ~19.3GB headroom — about 1 concurrent instance.
Q8_0 · ~37GBRuns well - Qwen2.5 32BQwen · ~32B · 128K ctx · Apache-2.0
Fits at Q8_0 (~34GB) with ~22.3GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well - Qwen3 32BQwen · ~32B · 128K ctx · Apache-2.0
Fits at Q8_0 (~34GB) with ~22.3GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well
Build a private AI Business OS on AMD Instinct MI210 64GB
Run your own AI agents on hardware you control — private by design, no per-seat data leaving your premises. BrainOutput helps you pick the right machine and turn it into a working AI Business OS.
Explore the AI Business OS