RigFit › Models › Qwen3 235B-A22B (MoE)

Best GPU for Qwen3 235B-A22B (MoE) (2026)

Qwen3 235B-A22B (MoE) needs roughly 135 GB of VRAM even at 4-bit (Q4), more than any single GPU we track. Your realistic options are two or more cards, CPU offload, or renting a datacenter GPU by the hour.

Prices updated Nov 12, 2026 · model on Hugging Face

Cheapest card that fits, by quantization

Quant	VRAM needed	Cheapest GPU that fits
Q4	135.2 GB	No single GPU we track fits; needs multi-GPU
Q8	235.1 GB	No single GPU we track fits; needs multi-GPU
FP16	440.4 GB	No single GPU we track fits; needs multi-GPU

*Rough estimate from memory bandwidth, single user. Context for text models: 8K tokens. Model specs: 235.1B parameters (22.2B active per token, mixture-of-experts); 94 layers, 4 KV heads × 128 head dim (from Hugging Face metadata, fetched 2026-10-18).

Or rent a GPU for Qwen3 235B-A22B (MoE)

Quant	VRAM needed	Cheapest rentable GPU that fits
Q4	135.2 GB	No single rentable GPU we track has enough VRAM; needs a multi-GPU pod
Q8	235.1 GB	No single rentable GPU we track has enough VRAM; needs a multi-GPU pod
FP16	440.4 GB	No single rentable GPU we track has enough VRAM; needs a multi-GPU pod

Cheapest on-demand hourly prices found 2026-11-12 05:55 ET. Marketplace prices move by the minute. Compare all rental prices and the buy-vs-rent break-even →

Try other settings

Model

Quantization

Context length

FAQ

How much VRAM does Qwen3 235B-A22B (MoE) need?

About 135 GB at Q4, 235 GB at Q8, 440 GB at FP16 (including a 8K-token KV cache and ~1 GB runtime overhead).

What is the best budget GPU for Qwen3 235B-A22B (MoE)?

No single consumer card fits; look at 2x 24 GB cards or renting.

How fast will it run?

Token generation on a single GPU is limited mostly by memory bandwidth. Our tokens/sec figures are estimates (0.6 × bandwidth ÷ bytes read per token) and real results vary by backend and settings.

Other models