5050 planed aka 5060 and 5060Ti with 9GB VRAM

Posted by Nyghtbynger@reddit | LocalLLaMA | View on Reddit | 9 comments

https://www.techpowerup.com/348234/nvidia-geforce-rtx-5060-and-5060-ti-planned-with-9-gb-vram

It was recently revealed that NVIDIA plans to launch a version of the RTX 5050 GPU with 9 GB of VRAM—three 3 GB modules of GDDR7 over a 96-bit bus and 336 GB/s total memory bandwidth...

Damn.

I was just scrolling to see how much memory it requires to host quantized Kimi K2.5. I have high expectations for the next generation of GPU, I hope they will have a lot of VRAM.

[-]

NickCanCode@reddit

It will probably stay like that for gaming cards due to Nvidia's Neural Texture Compression (NTC) technology.

[-]

Pomegranate-and-VMs@reddit

Isn’t 336 GB/s kind of slow these days? Or is this different with a 96-bit bus?

[-]

For 9GB it's fine. Higher speed on a small memory footprint is enough. 336GB/S on 9GB model is equivalent to 600GB/s on a 16GB model. (like my RX 7800XT. You'll notice the difference however if you put a 9GB model on a card with higher memory bandwidth

I was mainly skeptical of theses memory reductions left and right.

[-]

Pomegranate-and-VMs@reddit

That’s a good point. You’re not waiting on a 128k cache to prefill with that size model.

[-]

pmttyji@reddit

[-]

def_not_jose@reddit

Maybe they'll un-cancel 5070 Ti 24 gb too...

[-]

Johnny_Rell@reddit

They won't have much VRAM, maybe just slightly more than the current gen if we're lucky enough. The consumer segment generates barely any income for Nvidia compared to corporate clients. For them, it makes more sense to dump all that memory into data centers and such and get a 10x return.