Best Local Coding LLMs
Open coding models for private in-editor completion, pull-request review and refactoring — ranked, with the minimum and recommended workstation for each. Keep proprietary source on hardware your team controls.
- 1CodeLlama 34BCodeLlama · ~34B · 16K ctx · Llama Community License
The largest CodeLlama, suitable for review and refactoring. Newer 32B-class open coders generally beat it now; included for completeness of the family.
Minimum: NVIDIA GeForce RTX 3090Recommended: NVIDIA B200 (placeholder) - 2Qwen2.5-Coder 32BQwen · ~32B · 128K ctx · Apache-2.0
A leading open coding model and a natural backbone for a serious local coding / product-engineering agent.
Minimum: NVIDIA GeForce RTX 3090Recommended: NVIDIA B200 (placeholder) - 3DeepSeek-Coder V2 (class)DeepSeek · ~16B · 128K ctx · DeepSeek License
Representative entry for the DeepSeek coding family. Sizes vary widely across releases — verify the exact variant and its footprint before deploying.
Minimum: Intel Arc A770 16GBRecommended: NVIDIA B200 (placeholder) - 4StarCoder2 15BStarCoder · ~15B · 16K ctx · BigCode OpenRAIL-M
The largest StarCoder2, trained on permissively-licensed code across many languages. Review the BigCode OpenRAIL-M license restrictions before commercial use.
Minimum: NVIDIA GeForce RTX 3060 12GBRecommended: NVIDIA B200 (placeholder) - 5Qwen2.5-Coder 14BQwen · ~14B · 128K ctx · Apache-2.0
The mid-size coder: noticeably stronger than 7B for review and refactoring while still fitting a single 16GB card. A great private coding-agent backbone.
Minimum: NVIDIA GeForce RTX 3060 12GBRecommended: NVIDIA B200 (placeholder) - 6CodeLlama 13BCodeLlama · ~13B · 16K ctx · Llama Community License
A mid-size CodeLlama. Solid and widely supported, though newer open coders of similar size tend to score higher on coding tasks.
Minimum: NVIDIA GeForce RTX 3060 12GBRecommended: NVIDIA B200 (placeholder)
Run a private coding agent on your own hardware
Run your own AI agents on hardware you control — private by design, no per-seat data leaving your premises. BrainOutput helps you pick the right machine and turn it into a working AI Business OS.
Explore the AI Business OS