Anyone here making a local server off their hardware and opening it up to the public for profit?
Posted by A4_Ts@reddit | LocalLLaMA | View on Reddit | 8 comments
I came across a post in Ethereum and people back then were using their GPUs to mine Eth, it then went to proof of stake which basically means that their GPUs became worthless on the blockchain.
Now a good amount of these people that were mining had a whole room's space full of GPUs, massive storage rooms or more. It got me thinking to if profit could be made if any using all that hardware for AI now
ToxicTryhardGandhi@reddit
actually thought of building something like this, but instead of distributed compute and all that, just rent gpus and charge on a "per-time-theyre-running" basis. would you pay for something like that? never 429s, never overcommit.
HopePupal@reddit
Vast got there way ahead of you. also there's a volunteer version https://aihorde.net/
A4_Ts@reddit (OP)
That's interesting, do you know of any other ones by chance?
Azuriteh@reddit
lium is pretty good, at least from a customer-facing client, I actually prefer it over vast lol
HopePupal@reddit
nope, post them if you find any
Torodaddy@reddit
Theres lots of projects like this, just back of the envelope its not worth it due to electricity costs and the running down of your consumer hardware as its run at 100% capacity for days at a time. Theres a reason why datacenters are so expensive.
TheDailySpank@reddit
Distributed computing has been a thing for a long time, see: distributed.net
AurumDaemonHD@reddit
I guess thats the concept of ai horde.