New NVIDIA B300 · 288 GB HBM3e servers — from $4,019/mo per GPU

See the B300

Open model · Qwen · Apache 2.0

Run Qwen3.6 35B-A3B
on your own GPUs.

Fast vision-language MoE: only 3B parameters active per token. 35B MoE · 3B active parameters, 72 GB of official BF16 weights.

  • 86 GBGPU memory, BF16
  • 43 GBGPU memory, FP8
  • 1× RTX 5090cheapest server, Ollama
  • $329per month

How much VRAM Qwen3.6 35B-A3B needs.

Weights × 1.2 for the KV cache and activations, with 92% of GPU memory usable: the rule our deploy page uses. Long contexts and many parallel requests need more.

GPU memory needed for Qwen3.6 35B-A3B and cheapest server
Serving optionGPU memoryCheapest serverPer monthAction
vLLM or SGLang, official BF16 weights 86 GB 1× NVIDIA RTX PRO 6000 $959/mo Deploy
vLLM or SGLang, FP8 43 GB 2× NVIDIA RTX 4090 $538/mo Deploy
Ollama + Open WebUI, qwen3.6:35b (quantized) 28 GB 1× NVIDIA RTX 5090 $329/mo Deploy

Weights: Qwen/Qwen3.6-35B-A3B · 72 GB, BF16 · Ollama: qwen3.6:35b, 23 GB. How we estimate GPU memory

Which GPUs run Qwen3.6 35B-A3B.

Smallest server of each GPU that holds the model, and its monthly price.

Number of GPUs needed for Qwen3.6 35B-A3B on each GPU model
GPUBF16FP8OllamaPrice, BF16
NVIDIA B300288 GB HBM3e $4,019/mo
NVIDIA B200180 GB HBM3e $3,439/mo
AMD MI355X288 GB HBM3E n/a n/a
NVIDIA H200141 GB HBM3e $2,279/mo
NVIDIA H10080 GB HBM3 $3,558/mo
NVIDIA RTX PRO 600096 GB GDDR7 ECC $959/mo
NVIDIA L40S48 GB GDDR6 ECC $1,578/mo
NVIDIA RTX 509032 GB GDDR7 $1,316/mo
NVIDIA RTX 409024 GB GDDR6X $1,076/mo
NVIDIA RTX 508016 GB GDDR7

n/a = ROCm support for this model is not confirmed with vLLM or SGLang. — = larger than the biggest server of that GPU. Size another model

Deploy Qwen3.6 35B-A3B preinstalled.

Pick the model at the Software step of the deploy page: we install it with the engine you choose, at no extra cost.

  1. 1

    Pick the server

    The deploy page proposes the cheapest server that holds the model, and switches when you change the precision or the engine.

  2. 2

    Pick the engine

    vLLM or SGLang serve an OpenAI-compatible API; Ollama with Open WebUI gives a private chat in the browser.

  3. 3

    Pay and log in

    Pay the month in BTC, ETH, USDT, XMR or LTC, no KYC. Your server is online in under 10 minutes after confirmation, with root SSH access.

Guides: serving LLMs with vLLM · GPU servers for LLM inference · first steps on your server

Qwen3.6 35B-A3B FAQ.

Every model: open models and their VRAM.

How much VRAM does Qwen3.6 35B-A3B need?

About 86 GB of GPU memory to serve the official BF16 weights (72 GB) with vLLM or SGLang, by our rule of weights × 1.2 for the KV cache and activations; about 43 GB in FP8; about 28 GB with Ollama’s qwen3.6:35b build. Long contexts and many parallel requests need more.

Can Qwen3.6 35B-A3B run on a single GPU?

Yes, on one B300, B200, MI355X, H200, H100, RTX PRO 6000, L40S or RTX 5090 with Ollama + Open WebUI, qwen3.6:35b (quantized), by our sizing rule.

What is the cheapest server for Qwen3.6 35B-A3B?

The cheapest CryptGPU server for Qwen3.6 35B-A3B is 1× NVIDIA RTX 5090 at $329 a month, with Ollama + Open WebUI, qwen3.6:35b (quantized). The model can be preinstalled at no extra cost when you order, and you pay in crypto with no KYC.

Does Qwen3.6 35B-A3B run on the AMD MI355X?

Not confirmed with vLLM or SGLang on ROCm yet, so we offer it on NVIDIA servers; with Ollama it also runs on the MI355X.

What licence does Qwen3.6 35B-A3B use?

Apache 2.0. We download the official weights from Hugging Face (Qwen/Qwen3.6-35B-A3B); you are responsible for the licence.

Your own Qwen3.6 35B-A3B, ready in minutes.

Dedicated GPUs, one monthly price, the model preinstalled. Paid in crypto, no KYC.

Customer area

Sign in to CryptGPU

Your orders, invoices and servers in one place.

New to CryptGPU?

Accounts are created at checkout: choose your server and software, then create your account in the Account step of your first order.

Deploy a server