Honest take on running 9× RTX 3090 for AI
Posted by Outside_Dance_2799@reddit | LocalLLaMA | View on Reddit | 255 comments
[my home server](https://preview.redd.it/ry0d887xamqg1.jpg?width=3000&format=pjpg&auto=webp&s=0a8e456e366c5c31ba62a1c1523dd547015b37b3)
[3090 4way](https://preview.redd.it/r2p54vsvamqg1.jpg?width=4000&format=pjpg&auto=webp&s=bed6026c8ff57a8c7526641995bceccdb23e4c62)
I bought 9 RTX 3090s.
They’re still one of the best price-to-VRAM GPUs available.
Here’s the conclusion first: 1. I don’t recommend going beyond 6 GPUs 2. If your goal is simply to use AI, just pay for a cloud LLM subscription 3. Proxmox is, in my experience, one of the best OS setups for experimenting with LLMs
To be honest, I had a specific expectation:
If I could build around 200GB of VRAM, I thought I’d be able to run something comparable to Claude-level models locally.
That didn’t happen.
Reality check
Even finding a motherboard that properly supports 4 GPUs is not trivial.
Once you go beyond that: • PCIe lane limitations become real • Stability starts to degrade • Power and thermal management get complicated
The most unexpected part was performance.
Token generation actually became slower when scaling beyond a certain number of GPUs.
More GPUs does not automatically mean better performance, especially without a well-optimized setup.
What I’m actually using it for
Instead of trying to replicate large proprietary models, I shifted toward experimentation.
For example: • Exploring the idea of building AI systems with “emotional” behavior • Running simulations inspired by C. elegans inside a virtual environment • Experimenting with digitally modeled chemical-like interactions
Is the RTX 3090 still worth it?
Yes.
At around $750, 24GB VRAM is still very compelling.
In my case, running 4 GPUs as a main AI server feels like a practical balance between performance, stability, and efficiency. (wake up 4way warriors!)
Final thoughts
If your goal is to use AI efficiently, cloud services are the better option.
If your goal is to experiment, break things, and explore new ideas, local setups are still very valuable.
Just be careful about scaling hardware without fully understanding the trade-offs.
255 Comments
__JockY__@reddit
Outside_Dance_2799@reddit (OP)
__JockY__@reddit
Outside_Dance_2799@reddit (OP)
__JockY__@reddit
stoppableDissolution@reddit
__JockY__@reddit
Mchanger@reddit
__JockY__@reddit
Mchanger@reddit
fiery_prometheus@reddit
Prudent-Ad4509@reddit
__JockY__@reddit
Prudent-Ad4509@reddit
Mchanger@reddit
Prudent-Ad4509@reddit
__JockY__@reddit
pulsar080@reddit
ortegaalfredo@reddit
mdziekon@reddit
pulsar080@reddit
mj3815@reddit
ortegaalfredo@reddit
rbit4@reddit
Current_Ferret_4981@reddit
Outside_Dance_2799@reddit (OP)
SwooshMe@reddit
tmvr@reddit
Makers7886@reddit
ortegaalfredo@reddit
Makers7886@reddit
danirebollo@reddit
Makers7886@reddit
Myarmhasteeth@reddit
ortegaalfredo@reddit
Outside_Dance_2799@reddit (OP)
SolinK3@reddit
childofsol@reddit
Makers7886@reddit
Outside_Dance_2799@reddit (OP)
freddycheeba@reddit
Myarmhasteeth@reddit
shaunlmason@reddit
jeffwadsworth@reddit
c0verf1re@reddit
mckirkus@reddit
Timely-Beyond-4339@reddit
I_will_delete_myself@reddit
ortegaalfredo@reddit
I_will_delete_myself@reddit
sleepy_roger@reddit
calamitymic@reddit
croptopped_wanderer@reddit
dzedaj@reddit
mumblerit@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
inevitabledeath3@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
inevitabledeath3@reddit
MitsotakiShogun@reddit
tmvr@reddit
ChocomelP@reddit
relmny@reddit
FullstackSensei@reddit
Potential-Leg-639@reddit
FullstackSensei@reddit
inevitabledeath3@reddit
FullstackSensei@reddit
inevitabledeath3@reddit
FullstackSensei@reddit
Potential-Leg-639@reddit
segmond@reddit
FullstackSensei@reddit
FullstackSensei@reddit
Visual_Strawberry276@reddit
FullstackSensei@reddit
Visual_Strawberry276@reddit
FullstackSensei@reddit
loloferrari@reddit
Outside_Dance_2799@reddit (OP)
Medium_Chemist_4032@reddit
Outside_Dance_2799@reddit (OP)
EbbNorth7735@reddit
FullstackSensei@reddit
Empowerpreneur@reddit
Sizzin@reddit
MitsotakiShogun@reddit
Hoak-em@reddit
1ncehost@reddit
Hoak-em@reddit
Hoak-em@reddit
Dry_Assistance8995@reddit
DataGOGO@reddit
Outside_Dance_2799@reddit (OP)
DataGOGO@reddit
Beneficial-Border-26@reddit
kevin_1994@reddit
Eyelbee@reddit
kevin_1994@reddit
Eyelbee@reddit
kevin_1994@reddit
Eyelbee@reddit
kevin_1994@reddit
Civil_Response3127@reddit
kevin_1994@reddit
Civil_Response3127@reddit
kevin_1994@reddit
Civil_Response3127@reddit
moofunk@reddit
Civil_Response3127@reddit
Civil_Response3127@reddit
crumbaker@reddit
heliosythic@reddit
kevin_1994@reddit
waka324@reddit
EffectiveCeilingFan@reddit
delicious_fanta@reddit
EffectiveCeilingFan@reddit
Orolol@reddit
kevin_1994@reddit
segmond@reddit
kevin_1994@reddit
segmond@reddit
Civil_Response3127@reddit
sleepy_roger@reddit
SnooBananas5215@reddit
JsThiago5@reddit
kevin_1994@reddit
segmond@reddit
V0dros@reddit
kevin_1994@reddit
V0dros@reddit
tronathan@reddit
ScoreUnique@reddit
tronathan@reddit
ScoreUnique@reddit
kevin_1994@reddit
Outside_Dance_2799@reddit (OP)
a_beautiful_rhind@reddit
Outside_Dance_2799@reddit (OP)
FishChillylly@reddit
heliosythic@reddit
a_beautiful_rhind@reddit
Current_Sock1483@reddit
UsualResult@reddit
salary_pending@reddit
Tibogaibiku@reddit
WrongdoerAway7602@reddit
Kamisekay@reddit
Cferra@reddit
Outside_Dance_2799@reddit (OP)
Cferra@reddit
Dangerous-Pen-2940@reddit
Conscious_Cut_6144@reddit
Mental-Trouble-317@reddit
Outside_Dance_2799@reddit (OP)
Mental-Trouble-317@reddit
warren-mann@reddit
Outside_Dance_2799@reddit (OP)
warren-mann@reddit
selipso@reddit
slavik-dev@reddit
setec404@reddit
Outside_Dance_2799@reddit (OP)
hugganao@reddit
Outside_Dance_2799@reddit (OP)
spiritxfly@reddit
Outside_Dance_2799@reddit (OP)
Fabulous_Fact_606@reddit
psyclik@reddit
stoppableDissolution@reddit
ortegaalfredo@reddit
kevin_1994@reddit
Outside_Dance_2799@reddit (OP)
stoppableDissolution@reddit
Makers7886@reddit
panchovix@reddit
Guinness@reddit
panchovix@reddit
segmond@reddit
Opteron67@reddit
FullOf_Bad_Ideas@reddit
Outside_Dance_2799@reddit (OP)
_acd@reddit
Outside_Dance_2799@reddit (OP)
Adorable_Weakness_39@reddit
PathfinderTactician@reddit
freddycheeba@reddit
tronathan@reddit
sleepy_roger@reddit
Potential-Leg-639@reddit
tronathan@reddit
pmv143@reddit
segmond@reddit
Fastpas123@reddit
segmond@reddit
Fastpas123@reddit
segmond@reddit
philip_laureano@reddit
IrisColt@reddit
IrisColt@reddit
ciprianveg@reddit
ortegaalfredo@reddit
FullOf_Bad_Ideas@reddit
ciprianveg@reddit
MooseZealousideal994@reddit
loloferrari@reddit
LegacyRemaster@reddit
Prudent-Ad4509@reddit
gwillen@reddit
AttitudeImportant585@reddit
gwillen@reddit
Outside_Dance_2799@reddit (OP)
Medium_Chemist_4032@reddit
FullOf_Bad_Ideas@reddit
hainesk@reddit
FullOf_Bad_Ideas@reddit
Outside_Dance_2799@reddit (OP)
corey_prak@reddit
spky-dev@reddit
lemondrops9@reddit
drahgon@reddit
traveddit@reddit
ndiphilone@reddit
prescorn@reddit
SnooRevelations4601@reddit
Outside_Dance_2799@reddit (OP)
SnooRevelations4601@reddit
Dundell@reddit
Outside_Dance_2799@reddit (OP)
Total_Activity_7550@reddit
ProfessionalSpend589@reddit
Outside_Dance_2799@reddit (OP)
Impossible_Art9151@reddit
Outside_Dance_2799@reddit (OP)
Such_Advantage_6949@reddit
Outside_Dance_2799@reddit (OP)
Such_Advantage_6949@reddit
Outside_Dance_2799@reddit (OP)
matt-k-wong@reddit
Outside_Dance_2799@reddit (OP)
Savings-Librarian393@reddit
Outside_Dance_2799@reddit (OP)