Hey guys, a lot has happened since my [last post(Now I need to explain this to her...)](https://old.reddit.com/r/LocalLLaMA/comments/1gjje70/now_i_need_to_explain_this_to_her/), but in short I did not move to the basement, and she loved some of your comments :"D.
A little update: My originally [8x3090 setup](https://ahmadosman.com/blog/serving-ai-from-the-basement-part-i/) is currently 14x3090s. I am even more down the rabbit hole with Agentic Workflows, RAG, Data Pipelines, and a lot of LLM stuff. I talked about what I am doing a bit in [the Part II of my blogpost series](https://ahmadosman.com/blog/serving-ai-from-the-basement-part-ii/) and in this [orphan blogpost about talking with Antifragile by NNT](https://ahmadosman.com/blog/taleb-antifragile-ai-insights/). If you know any VCs, let me know - I’m working on something that might catch their interest ;)
I have been writing the third part documenting this entire process and I am aiming for it to be your go-to guide in case you want to build a similar setup.
The specs as they stand:
- Asrock Rack ROMED8-2T w/ 7x PCIe 4.0x16 slots and 128 lanes of PCIe
- AMD Epyc Milan 7713 CPU (2.00 GHz/3.675GHz Boosted, 64 Cores/128 Threads)
- 512GB DDR4-3200 3DS RDIMM memory
- 5x Super Flower Leadex Titanium 1600W 80+ Titanium PSUs
- 14x RTX 3090 GPUs with 7x NVLinks
P.S. Thanks to /u/iLaux for anointing my server as the [*Final Boss*](https://old.reddit.com/r/LocalLLaMA/comments/1gjje70/now_i_need_to_explain_this_to_her/lvdk9d1/)
1 Comments
XMasterrrr@reddit (OP)