Alternative_Ad4267
-
Follow up, adopting vLLM and booting on multi-user.target on 4 Nvidia RTX A4000 setup
Posted by Alternative_Ad4267@reddit | LocalLLaMA | View on Reddit | 3 comments
-
Qwen 3.6 27B Q8 on four Nvidia RTX A4000 (16GB each) with Llama.cpp and MTP enabled
Posted by Alternative_Ad4267@reddit | LocalLLaMA | View on Reddit | 24 comments