RTX Pro 4000 Benchmarks?

Posted by QuantumUtility@reddit | LocalLLaMA | View on Reddit | 5 comments

Has anyone found any of these anywhere? I couldn’t find any reviews of benchmarks but I have a supplier willing to sell me one.

I have a very small server that currently has a 4060Ti 16 GB and am considering upgrading for the extra vram and memory bandwidth. (20w smaller TDP is also nice. I’m already pushing the power envelope with a 14900k and 8 HDDs.)

My biggest limitations are power, space and heat so I don’t really want to turn this server into a monster with multiple (or even one) 300W+ cards as it seats in a bedroom. Noise is a concern as well considering it’s a blower. (The 4060 Ti idles with fans off, which is very nice.)

This is a small Deep M-itx board on a 500w HDPLEX PSU that doubles up as a NAS/Media server/seedbox. I host small models for myself, friends and family. Been trying to get some image and video generation going with ComfyUI + Open Web UI as well so I think the extra vram could help a lot there.