AWS EC2 (L40S) — 256GB / 2TB
A cloud instance built on the NVIDIA L40S 48GB with about 48GB of memory usable for AI — here’s what it runs and how it fits a private AI Business OS.
Some details here are provisional (to-verify). Treat specs as approximate and verify against the manufacturer before relying on them or purchasing.
Configuration
- AI memory
- ~48GB
- Usable for models
- ~42.2GB
- System RAM
- 256GB
- Storage
- 2TB
- GPUs
- 1×
- Chip
- NVIDIA L40S 48GB
Compatible models
Open models graded for this exact configuration.
- Mixtral 8x7B (MoE)Mistral · ~47B · 32K ctx · Apache-2.0
Fits at Q4_K_M (~28GB) with ~14.2GB headroom — about 1 concurrent instance.
Q4_K_M · ~28GBRuns well - CodeLlama 34BCodeLlama · ~34B · 16K ctx · Llama Community License
Fits at Q8_0 (~37GB) with ~5.2GB headroom — about 1 concurrent instance.
Q8_0 · ~37GBRuns well - Qwen2.5 32BQwen · ~32B · 128K ctx · Apache-2.0
Fits at Q8_0 (~34GB) with ~8.2GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well - Qwen3 32BQwen · ~32B · 128K ctx · Apache-2.0
Fits at Q8_0 (~34GB) with ~8.2GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well - DeepSeek-R1 Distill 32BDeepSeek · ~32B · 128K ctx · MIT
Fits at Q8_0 (~34GB) with ~8.2GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well - Qwen2.5-Coder 32BQwen · ~32B · 128K ctx · Apache-2.0
Fits at Q8_0 (~34GB) with ~8.2GB headroom — about 1 concurrent instance.
Q8_0 · ~34GBRuns well - Gemma 2 27BGemma · ~27B · 8K ctx · Gemma Terms of Use
Fits at Q8_0 (~29GB) with ~13.2GB headroom — about 1 concurrent instance.
Q8_0 · ~29GBRuns well - Gemma 3 27BGemma 3 · ~27B · 128K ctx · Gemma Terms of Use
Fits at Q8_0 (~29GB) with ~13.2GB headroom — about 1 concurrent instance.
Q8_0 · ~29GBRuns well
Offers
No offers yet. Pricing will appear here once a retailer/affiliate feed is connected.
Turn the AWS EC2 (L40S) into a private AI Business OS
Run your own AI agents on hardware you control — private by design, no per-seat data leaving your premises. BrainOutput helps you pick the right machine and turn it into a working AI Business OS.