Can I install Qwen3.6 27b on my computer?

Posted by drazyan22@reddit | LocalLLaMA | View on Reddit | 21 comments

Here is my computer. I want to use Qwen3.6 27b for coding but my GPU just have 16gb Vram. Can I install it or not? or I need to sell GPU and buy new one with 24gb Vram?

[-]

sagiroth@reddit

Too much quant to run on 16gb vram. Better off 35A3B. Otherwise vram 24 gpu

[-]

drazyan22@reddit (OP)

Thanks for your reply. I think I'll sell my GPU and buy new one

[-]

LagOps91@reddit

Better run the 124b model actually since it's an MoE and you can make use of your 64gb ram (if I read that correctly). Q4 should fit.

[-]

Finanzamt_kommt@reddit

Do you still have an old gpu lying around? Because with that you get a small slowdown compared better gpus but in vram is always faster than if you spill over.

[-]

drazyan22@reddit (OP)

Unfortunately, I don’t have any spare GPU. I might have to stick with a smaller model or upgrade later.

[-]

sagiroth@reddit

Terrible time to buy one tbh, I would advise on used 3090 if u can find one at decent price over new

[-]

Academic-Map268@reddit

You can fit Q3_K_M in your VRAM and offload the KV cache. It should be smarter than the 35B since dense models are less sensitive to quantization.

[-]

Long_comment_san@reddit

You need to download more ram.

Use 35b a3b, it's basically designed for system like ours (I have 64+12)

[-]

Lost-Health-8675@reddit

But with ram prices find a cracked one, so you get it for free

[-]

KURD_1_STAN@reddit

U can run q3 km or maybe just maybe run q3 kxl with lower context. But wait for gguf chart to see if they are worth it.

[-]

If they made qwen3.6 122b then u should try that, it is perfect for ur system. Cause this is really not the time to buy any xomputer hardware, or it it is the best time cause it can get 10 times worse, who knows.

[-]