ReasoningMoE · 37B activeDeepSeek · Jan 2025

DeepSeek R1 671B Hardware Requirements

The model that made reasoning open. The full 671B needs server hardware (~400GB+), and its lineage now lives on in DeepSeek V4 — but this page exists because people still ask. Run a distill instead.

Frontier reasoningMIT licenseMLA = tiny KV cache

VRAM needed (Q4, 8k context)

409 GB

No single consumer GPU fits this model — see multi-GPU and Mac options below.

Updated July 2026. Estimates — see methodology below.

VRAM by Quantization

Weights + KV cache at 8k context + 1.2GB system overhead. Q4_K_M is the community default — quality loss is negligible for most use.

QuantizationWeightsKV cache (8k)Total VRAMCheapest GPU that fits
Q4_K_M

Recommended — near-lossless for most use, half the size of Q8

407 GB0.5 GB409 GBMulti-GPU / Mac territory
Q5_K_M

Slightly higher quality than Q4 for ~18% more VRAM

478 GB0.5 GB480 GBMulti-GPU / Mac territory
Q8_0

Effectively lossless — use if you have VRAM to spare

713 GB0.5 GB715 GBMulti-GPU / Mac territory
FP16

Full precision — only for fine-tuning or maximum fidelity

1342 GB0.5 GB1344 GBMulti-GPU / Mac territory

Longer context costs VRAM

KV cache grows linearly with context: 8k → 0.5 GB · 32k → 2.2 GB · 128k → 8.8 GB. If you plan to feed whole documents or codebases, size your GPU for the context you actually need, not just the weights.

Why DeepSeek R1 671B is fast but VRAM-hungry

DeepSeek R1 671B is a Mixture-of-Experts model: all 671B parameters must sit in memory, but each token only activates 37B of them. Memory capacity requirements are those of a 671B model, while speed is that of a 37B model — which is why MoE models feel so fast when they fit, and why Macs with large unified memory punch above their weight running them.

GPU Compatibility (Q4, 8k context)

Every GPU in our database, scored against DeepSeek R1 671B. Speed is estimated decode rate — memory-bandwidth-bound, so VRAM and bandwidth matter more than shader count.

GPUVRAMVerdictEst. speedPrice
RTX 306012 GBNot enough VRAM~$238 used
Arc B57010 GBNot enough VRAMfrom $225
RTX 40608 GBNot enough VRAM~$275 used
RX 76008 GBNot enough VRAMfrom $250
Arc B58012 GBNot enough VRAMfrom $250
RX 6700 XT12 GBNot enough VRAM~$315 used
Arc A77016 GBNot enough VRAMfrom $300
RTX 4060 Ti8 GBNot enough VRAM~$338 used
RTX 30708 GBNot enough VRAM~$338 used
RTX 50608 GBNot enough VRAMfrom $325
RX 7700 XT12 GBNot enough VRAM~$415 used
RX 6800 XT16 GBNot enough VRAM~$438 used
RTX 308010 GBNot enough VRAM~$463 used
RX 7800 XT16 GBNot enough VRAM~$488 used
RTX 407012 GBNot enough VRAM~$500 used
RTX 4070 SUPER12 GBNot enough VRAM~$563 used
RX 7900 XT20 GBNot enough VRAM~$588 used
RTX 5060 Ti16 GBNot enough VRAMfrom $550
RX 907016 GBNot enough VRAMfrom $575
RTX 507012 GBNot enough VRAMfrom $600
RX 9070 XT16 GBNot enough VRAMfrom $600
RTX 4070 Ti SUPER16 GBNot enough VRAM~$750 used
RX 7900 XTX24 GBNot enough VRAM~$838 used
RTX 4080 SUPER16 GBNot enough VRAM~$900 used
RTX 5070 Ti16 GBNot enough VRAMfrom $900
RTX 309024 GBNot enough VRAM~$1,150 used
RTX 508016 GBNot enough VRAMfrom $1,250
RTX 409024 GBNot enough VRAM~$2,375 used
RTX 509032 GBNot enough VRAMfrom $2,800

Run it in one command

With Ollama installed, this pulls the default quant and starts chatting:

$ ollama run deepseek-r1:671b

Frequently Asked Questions

How much VRAM do I need to run DeepSeek R1 671B?+

At the recommended Q4_K_M quantization with 8k context, DeepSeek R1 671B needs roughly 409GB of VRAM (407GB weights + KV cache + overhead). Q8 needs about 715GB and full FP16 about 1344GB.

Can any single consumer GPU run DeepSeek R1 671B?+

No single consumer GPU currently has enough VRAM to run DeepSeek R1 671B fully. Realistic options: a multi-GPU rig (e.g. dual 24GB cards), a Mac with enough unified memory, or a 128GB Ryzen AI Max "Strix Halo" mini-PC — the 2026 favorite for exactly this class of model.

Can I run DeepSeek R1 671B on an RTX 3060?+

No — 12GB is well below what DeepSeek R1 671B needs even at Q4 quantization.

Can I run DeepSeek R1 671B on a Mac?+

Yes, if the Mac has enough unified memory: budget roughly 409GB of RAM for the Q4 version (plus what macOS itself uses). Apple Silicon runs GGUF models well via Ollama or LM Studio, and MoE models like this one are particularly Mac-friendly — only 37B parameters are active per token, so memory bandwidth goes further.

Can I run DeepSeek R1 671B on CPU only?+

Sort of. Because only 37B of 671B parameters are active per token, CPU inference is more viable than for dense models this size — expect single-digit tokens/sec with fast DDR5. A GPU is still dramatically better.

Is DeepSeek R1 671B free for commercial use?+

Yes. DeepSeek R1 671B is released under the MIT, which permits commercial use.

Related Models

How we calculate these numbers

VRAM = model weights (parameters × bits per weight ÷ 8) + KV cache (architecture-specific bytes per token × context length) + ~1.2GB runtime overhead. Speed estimates assume decode is memory-bandwidth-bound at ~50% utilization (lower for MoE models, which pay routing overhead), matching typical llama.cpp performance on consumer cards; real results vary with runtime, drivers, and settings. Quant sizes reflect GGUF K-quants, which keep some layers at higher precision. Figures are estimates for planning, not guarantees — when in doubt, buy more VRAM than you need today. Prices shown are launch MSRP; mid-2026 street prices often run well above MSRP due to the ongoing memory shortage, and used 24GB cards are holding their value unusually well.