Looking for a cheaper GPU platform for multi modal AI work
Posted by AgentSad427@reddit | LocalLLaMA | View on Reddit | 8 comments
Does anyone know a cheaper and reliable option? I am working on an AI project that involves video frame analysis and some audio preprocessing, so I need a GPU that can handle mixed workloads without timing out.
If anyone here is running similar workloads, which GPU platforms are giving you the best price to performance right now?
SashaUsesReddit@reddit
What are your requirements? Way different to ask how to solve a 32GB vram problem vs a 1TB vram problem.
Tell us more to ve helpful
Expensive-Eagle2076@reddit
northflank
AccomplishedBoss7738@reddit
Baidu
Tall_Instance9797@reddit
Maybe try https://cloud.vast.ai/ ...it's like airbnb for GPUs so you can rent pretty much anything from a single GTX 1080 with 8GB VRAM for $0.05 an hour all the way through to servers with 8x B200s and 1.4TB VRAM for $25 an hour. Rent by the hour, week, month etc. with regular options or trusted datacenter options for meeting various privacy / regulatory requirements, if the data you need to process is sensitive enough to require that, and if not no need to spend the extra.
I don't know what model you're using specifically but whatever your speed and VRAM requirements are you'll find something to match it because like with airbnb the options are endless.
frentro_max@reddit
I ended up trying Hivenet and it worked out pretty well. Their 4090 and 5090 pricing is way lower than what I was paying before. Worth spinning up a small test run to see if it fits your workflow.
indicava@reddit
You’re not gonna find anything cheaper than vast.ai, either that or RunPod. Don’t even think about the big Cloud providers as their prices are usually 5x-10x higher for the same compute, and that’s if you’re lucky enough to get an allocation.
One_Yogurtcloset4083@reddit
https://cloud.vast.ai/?ref_id=343946
Or, if you prefer no referral and no bonus url: vast.ai
Renting a 3090 here for $0.117/hr
frentro_max@reddit
I ended up trying Hivenet and it worked out pretty well. Their 4090 and 5090 pricing is way lower than what I was paying before. Worth spinning up a small test run to see if it fits your workflow.