Bedt current model for 48vram

Posted by Bobcotelli@reddit | LocalLLaMA | View on Reddit | 2 comments

what are the best current models to use with 48 ram and ryzen 9 9900x and 96 gb ddr5 ram. Should I use them for completion reformulation etc of legal texts.

Reply to Post

2 Comments

[-]

My_Unbiased_Opinion@reddit

Qwen 3 32B at Q8 for coding. You can also use Legion 2.1 70B. A surprisingly solid finetune that can code and do rp. It's quite uncensored. Qwen is good. But depending on use case, more parameters win.

[-]

Thomas-Lore@reddit

Qwen 3 32B will fit in vram on your setup. Qwen 3 235B might work at low quant.