Anyone with experience combining Nvidia system & mac over llama-rpc?

Posted by segmond@reddit | LocalLLaMA | View on Reddit | 6 comments

Anyone with experience combining Nvidia system & mac over llama-rpc?

I'm sick of building Nvidia RIGs that are useless with these models. I could manage fine with commandR & MistralLarge, but since llama405B, deepseekv2.5, R1, v3, etc are all out of reach. So I'm thinking of getting an apple next and throwing it on the network. Apple is not cheap either, i"m broke from my Nvidia adventures... so a 128gb would probably be fine. If you have practical experience, please share.