TheaterFire

LocalLLaMA Home Server Final Boss: 14x RTX 3090 Build

Posted by XMasterrrr@reddit | LocalLLaMA | View on Reddit | 1 comments

LocalLLaMA Home Server Final Boss: 14x RTX 3090 Build

Reply to Post

1 Comments

XMasterrrr@reddit (OP)

Hey guys, a lot has happened since my [last post(Now I need to explain this to her...)](https://old.reddit.com/r/LocalLLaMA/comments/1gjje70/now_i_need_to_explain_this_to_her/), but in short I did not move to the basement, and she loved some of your comments :"D. A little update: My originally [8x3090 setup](https://ahmadosman.com/blog/serving-ai-from-the-basement-part-i/) is currently 14x3090s. I am even more down the rabbit hole with Agentic Workflows, RAG, Data Pipelines, and a lot of LLM stuff. I talked about what I am doing a bit in [the Part II of my blogpost series](https://ahmadosman.com/blog/serving-ai-from-the-basement-part-ii/) and in this [orphan blogpost about talking with Antifragile by NNT](https://ahmadosman.com/blog/taleb-antifragile-ai-insights/). If you know any VCs, let me know - I’m working on something that might catch their interest ;) I have been writing the third part documenting this entire process and I am aiming for it to be your go-to guide in case you want to build a similar setup. The specs as they stand: - Asrock Rack ROMED8-2T w/ 7x PCIe 4.0x16 slots and 128 lanes of PCIe - AMD Epyc Milan 7713 CPU (2.00 GHz/3.675GHz Boosted, 64 Cores/128 Threads) - 512GB DDR4-3200 3DS RDIMM memory - 5x Super Flower Leadex Titanium 1600W 80+ Titanium PSUs - 14x RTX 3090 GPUs with 7x NVLinks P.S. Thanks to /u/iLaux for anointing my server as the [*Final Boss*](https://old.reddit.com/r/LocalLLaMA/comments/1gjje70/now_i_need_to_explain_this_to_her/lvdk9d1/)
View on Reddit #43488700