RTX 4090 48GB price drop?

[-]

ArtfulGenie69@reddit

Sounds like the same price. Btw before you buy you should know that they are using a gimped 4090 chip and the ram isn't the x version so there is at least a 15% slowdown from a real one. The more you know.

Reply

[-]

JaredsBored@reddit

4090 48GB cards are all over eBay for $3100~. So you can nearly buy 3 for the price of one RTX PRO 6000. Great for anyone who can't buy a 6000 and is willing to go without a reputable warranty

Reply

[-]

debackerl@reddit

Exactly, it's like saying you should buy a Porsche because you get more than twice the horsepower, but 2x the price. We can't always afford a Porsche 😅 actually the combined memory bandwidth of two 4090 is also greater than an RTX 6000 Pro's if I'm not mistaken. The warranty is the main issue, but I love my Chinese card. Of course, from Europe we don't pay the same import duties on Chinese goods as the US.

Reply

[-]

skyfallboom@reddit (OP)

To follow your analogy, it's like instead of having a Porsche capped at 200 km/h (I know), you have two Dacias capped at 100 each. Neither card offers an interconnect, so is the memory bandwidth capped by the PCIe bus? PCIe 5.0 motherboards, CPUs, and RAM aren't cheap but that's a good point. Are you batching requests?

Reply

[-]

DistanceSolar1449@reddit

Inference isn't PCIe bandwidth bound. Layer split inference (llama.cpp) just requires passing one block's activations to another block, which is roughly ~20KB per token, depending on the model. Tensor parallel inference (vLLM) just does an all reduce across all the rows in the layer and that takes ~5MB per token. You're not gonna saturate a 64GB/sec PCIe bus with that, lol. You only need PCIe bandwidth for finetuning or training your own model, but then you shouldn't be using 4090 or RTX6000 Pro class cards. You should just rent a B200 server in that case, it'd be a lot more suitable.

Reply

[-]

TokenRingAI@reddit

Rent an 8x3090 server on Runpod and show us how you get 8x the performance

Reply

[-]

DistanceSolar1449@reddit

Runpod doesn't offer 8x 3090s

Reply

[-]

TokenRingAI@reddit

Ok, true, go to Vast instead.

Reply

[-]

BeatTheMarket30@reddit

$3000 is a lot to pay for something from ebay without warranty

Reply

[-]

JaredsBored@reddit

You're not wrong. But, the factories making these cards are generally the same Chinese factories making regular GPUs. I wouldn't wager $3100 of my own dollars on it, but some people do.

Reply

[-]

tat_tvam_asshole@reddit

they're aftermarket repair shops, not OEM places

Reply

[-]

JaredsBored@reddit

Taking the GPU core from a donor gpu and placing it on a pcb for 48gb memory might happen at a repair shop. But the heatsink and pcb itself, along with all the power componentry, is 100% getting made in the same factories that make regular GPUs. It's not the GPU core that's most likely to fail, it's the power delivery on the PCB. Sure the solder job to attach the core to the PCB could fail, but generally if it works in testing, that's not going to fail before the power delivery does.

Reply

[-]

SuddenBaby7835@reddit

Electronic repair technician here. 90% of issues are caused by failed solder joins due to either poor workmanship or thermal cycling. 10% due to failed components.

Reply

[-]

tat_tvam_asshole@reddit

I'm not sure what you're on about. These PCBs are custom made by a manufacturer, sure, but the actual assembly are not happening en masse like OEM production. Nvidia I don't think would be okay if a board partner was also 2nd hand retrofitting 4090s with 48gb vram. it doesn't really make sense anyway.

Reply

[-]

JaredsBored@reddit

My point is that the step of actually placing the GPU core on the PCB is not that high risk. It either works or it doesn't, and that's easy to test. And if it doesn't, the assembler can redo it. The PCB board and cooler assembly are far more likely to fail. A power MOSFET on the PCB dying should be the concern, but that's also the assembly that's happening in the same factories as regular GPUs. Big pick and place assembly lines, probably in Shenzhen or the areas outside Shenzhen, are cranking out these PCBs and PCBs for other GPUs (and other products) all day long.

Reply

[-]

puppymaster123@reddit

Not true. All bleeding edge nvidia chip fabrication are made in Taiwan, with some assembly, packaging and testing spread out in Malaysia, Vietnam and etc. At best some China factories are doing the packaging.

Reply

[-]

JaredsBored@reddit

Only the chip fabrication happens in Taiwan. The packaging is increasingly but not always happening in Taiwan. But the packaging and fabrication, is just the GPU core. Everything else primarily happens in China. The mounting of the GPU core to a pcb, China. The PCB manufacturing and assembly, China. The cooler manufacturing and assembly, China. That's the irony in the US' chip restrictions on China. Everything except the high end data center stuff (anything that's not on a PCIE card), 100% passes through China for major steps in the manufacturing process.

Reply

[-]

koflerdavid@reddit

The issues are not the factories, but the people peddling them on eBay.

Reply

[-]

DistanceSolar1449@reddit

It's ebay. If it works, great. If it doesn't work, file a dispute and return it.

Reply

[-]

starkruzr@reddit

depends on your priorities I guess. if all you're trying to do is run large models entirely in VRAM you could also just buy 3 x 5060 Ti and get slower but still acceptable 48GB of VRAM.

Reply

[-]

Lost_my_phonehelp@reddit

What kind of mother board would recommended for a sap like that

Reply

[-]

starkruzr@reddit

I would use a low-end EPYC system for that

Reply

[-]

Conscious-Fee7844@reddit

That's used.. too.. no clue how much it was used. You could be buying a bad card or one that will crap out soon. Fawk that. I dont want someones old bitcoing gpu or one used for AI shit for months on end.. then I buy it for more than they paid for it.. makes no sense. Rather spend 9K on the RTX6000 Pro new.. and get the much faster memory bandwidth and 2x the memory.

Reply

[-]

JaredsBored@reddit

The only thing used about these cards is the GPU core, and the GPU core is 100% the most reliable thing on a card. To build a 48gb 4090, you need to use a different PCB, memory, and cooler. In ranked order, the things with the shortest lifespan on a GPU is: 1. The cooler fan 2. The power delivery on the PCB 3. The memory 4. The GPU core itself

Reply

[-]

Conscious-Fee7844@reddit

Fair enough.. I still wouldn't pay those kinds of prices for last gen card even with modifications.. and I assume modifications are done by small shops, not nvidia. It may work great.. I'd still be leery of it. But to each their own. Glad it works for those that are good with spending the money on it.

Reply

[-]

skyfallboom@reddit (OP)

My bad, at $3,100 it's more justified.

Reply

[-]

ac101m@reddit

You can get them for ~3000 Where are you seeing them at 4500?

Reply

[-]

skyfallboom@reddit (OP)

Sorry, I got outdated prices for the 4090D that made the post rather moot. They're also on eBay for $3,100. Thanks for sharing the link, I didn't know that website! Great to see they accept western payment methods. Taobao on the other hand is intimidating.

Reply

[-]

ac101m@reddit

To be fair, they were much better value when the top workstation card was the a6000 ada. They were about a third the price for the same or better performance. These days if you look at the vram/cost ratio, the 6000 pro has closed the gap quite a lot (though not completely).

Reply

[-]

Dr_Allcome@reddit

Someone who can't afford the 9k?

Reply

[-]

No_Palpitation7740@reddit

But the more you buy, the more you save, right?

Reply

[-]

crazyenterpz@reddit

You should spend spend $18K on Nividia. $9k for card, and another $9k on Nvidia stock. You will make your money back . Trust me .. I often visit r/wallstreetbets /s

Reply

[-]

_BreakingGood_@reddit

"It's only $4,500 more, it's a no brainer!"

Reply

[-]

MustafaMahat@reddit

Intel wil come out with a 48gb card soon. But it wont be cuda

Reply

[-]

BuildAQuad@reddit

Keep in mind it only has about 25% memory bandwidth of a 5090 as far as i understand it. At around 1200$ it's slightly steep imo.

Reply

[-]

MustafaMahat@reddit

Its 456GB/s for each GPU in the card. The B60 will contain two GPUs which should give you about 912GB/s speed. Given the assumption that these can be properly utilised to run a single model in parallel. Which is probably a big question mark?

Reply

[-]

BuildAQuad@reddit

Yea i was thinking/hoping the same, but as far as i understand, it won't be able to utilize it like that. But more similar to a dual GPU setup with maybe 40% gain with tensor parallelization? So say closer to 650 GB/s and that would be pretty decent id say.

Reply

[-]

SameIsland1168@reddit

Went through tears, blood, and pain to learn how to setup ROCm for AMD cards. Now I will have to do the same to eke out evermore performance for the intel cards too…

Reply

[-]

MustafaMahat@reddit

I guess you learned from it so the tears, blood and pain wont be that much worse 😅

Reply

[-]

SameIsland1168@reddit

no man, it’s maybe 10-15% faster than Vulkan 😭😭

Reply

[-]

a_beautiful_rhind@reddit

That's not a great deal. The 48gb 4090s can't do p2p so good. You need 2 of them to equal that pro 6000.

Reply

[-]

Xamanthas@reddit

> no p2p This is what so many deepseek effect users miss when they soapbox about these things.

Reply

[-]

kkb294@reddit

You can get one at 2250$ if you are in China or for 2400$ if you buy from Hongkong taobao. I don't know where you are getting charged 4500$. I got a couple of 4090 at 2150$ couple of months back and they are working absolutely fine. The only problem is the noise they make 🫨

Reply

[-]

SillyLilBear@reddit

The RTX 6000 Pro is only $7000-8000 and is a much better choice if you need more than one of the 4090.

Reply

[-]

GradatimRecovery@reddit

yes, but the 4090 48 is perfect for someone who only needs one

Reply

[-]

SillyLilBear@reddit

I'd argue the 5090 is a better choice for less than half the price.

Reply

[-]

GradatimRecovery@reddit

5090 is far \*more\* than half the price $2k vs $3k

Reply

[-]

SillyLilBear@reddit

How much is it. Thought it said $4500 in the post.

Reply

[-]

GradatimRecovery@reddit

post was wrong. 4090-48 is $3k on ebay, rtx 5000 pro will be $4k-ish. and as a practical matter it's hard to actually buy 5090's for $2k, it's more like $2.4k at best buy

Reply

[-]

TokenRingAI@reddit

It's easy to buy 5090s for $2k, just not the FE model

Reply

[-]

TokenRingAI@reddit

The RTX 6000 is only $7200. These prices for the 4090 are idiotic.

Reply

[-]

GTHell@reddit

https://preview.redd.it/5q1f8kjfqztf1.jpeg?width=1290&format=pjpg&auto=webp&s=f34a3004f65f02e8f659b5cb14f11509d69f44d2 2865 USD. Though you can always negotiate the price with them so I would say base is \~2700

Reply

[-]

amxn@reddit

Buy this for cheap and bump up memory: https://ebay.us/m/ldgvw8

Reply

[-]

beedunc@reddit

I heard the RTXPros don’t work as smoothly as the gamer cards for LLM compatibility.

Reply

[-]

PracticlySpeaking@reddit

Is it just me, or has talk of these modified 4090s dramatically increased since the Gamers Nexus videos covering them?

Reply

[-]

skizatch@reddit

RTX PRO 5000 has 48GB and is probably about as fast as the 4090. MSRP is about $4500 and you get the warranty too. The 4090 48GB can be a good option if the price is a lot lower or if you’re in China.

Reply

[-]

Freonr2@reddit

They're close. fp16/bf16 numbers: 4090 D: 73.54 TFLOP/s RTX 5000 Blackwell: 73.69 TFLOP/s RTX 4090 (full, non-D): 82.58 TFLOP/s Some others for reference: RTX 6000 Ada (golden die AD102/4090): 91.06 TFLOP/s RTX 6000 Pro Blackwell Workstation (600W): 126 TFLOP/s RTX 6000 Pro Blackwell Max-Q (300W): 110 TFLOP/s RTX 5090: 104.8 TFLOP/s The Blackwell/5xxx cards however offer extra fp4 acceleration, so if fp4 is used *properly* they should wreck the 4xxx/Ada cards. If FP4 is called for on an Ada card I assume it just falls back or casts to fp8 somewhere in the driver or cuda stack.

Reply

[-]

BuildAQuad@reddit

But the memory bandwidth is like 80% higher on the Blackwell series isn't it?

Reply

[-]

Freonr2@reddit

RTX 5000 Pro is ~1.34 TB/s, which is about 34% faster than the 4090 or RTX 6000 Ada at ~1 TB/s.

Reply

[-]

BuildAQuad@reddit

Ah strange, I thought it was closer to the 5090 at 1.8 TB/s my bad.

Reply

[-]

Due_Mouse8946@reddit

RTX pro 6000 is indeed 1.8TB

Reply

[-]

panchovix@reddit

Is the RTX 5000 PRO out there? I haven't seen one yet :(

Reply

[-]

skizatch@reddit

You can probably find one from exacct.com or hunting through Google Shopping. I’d haven’t seen a review or YT video with one yet, and only the 6000 and 4500 on eBay. So maybe they’re available but I don’t know for sure.

Reply

[-]

Puzzleheaded-Age-660@reddit

Just made a similar suggestion

Reply

[-]

Due_Mouse8946@reddit

Ps you can get a pro 6000 for $7k.

Reply

[-]

sixx7@reddit

+1 to this. Below 7k if you qualify for one of the discounts they offer. They are legit and an authorized reseller

Reply

[-]

Due_Mouse8946@reddit

This is correct. If you have a EDU email, you can get it for \~$6700.

Reply

[-]

skyfallboom@reddit (OP)

Thanks!

Reply

[-]

twiiik@reddit

Where?

Reply

[-]

skyfallboom@reddit (OP)

They replied in another comment: ExxactCorp

Reply

[-]

ArtisticHamster@reddit

How to get it for 7k$?

Reply

[-]

Due_Mouse8946@reddit

Directly from the supplier. ExxactCorp just request a quote and put your budget. https://preview.redd.it/a2fw6ti53xtf1.jpeg?width=4284&format=pjpg&auto=webp&s=bf7392adf462b4c6313770aeeaac5b32d85c145a

Reply

[-]

Narrow-Belt-5030@reddit

Jesus .. 13K from a local shop here and I am about to hit buy. Tempted to get 2 now from them. 1st world problems ..

Reply

[-]

Due_Mouse8946@reddit

Yeah. They are all resellers. ;) Pick up 2 of them. They have all the models. MAXQ, Server and Workstation

Reply

[-]

ArtisticHamster@reddit

Thanks!

Reply

[-]

koushd@reddit

have not ever seen it under 8k, where?

Reply

[-]

Due_Mouse8946@reddit

And you won’t. Suppliers to display prices. Always RFQ. Supplier is ExxactCorp official Nvidia supplier

Reply

[-]

DistanceSolar1449@reddit

> 4090 48GB cards > $4,500 Somebody is ripping you off. https://www.ebay.com/sch/i.html?_nkw=4090+48gb&_sacat=0&_from=R40&_sop=15

Reply

[-]

MelodicRecognition7@reddit

> $4,500 omgwtf this is incredibly expensive, they costed that at the very beginning when they just started to show up, then 4000, then 3500, and now you could find them for less than $3000.

Reply

[-]

Mabuse046@reddit

You might as well just ask who buys used instead of new? Who buys a 4060 instead of a 4090? I could save up and buy a $4500 gpu if I needed the vram but a $9K gpu? Not in a million years. I had to set money aside for months to buy my stock 4090 for $2K in the first place because having one was really important to me. We're not all made of money.

Reply

[-]

WizardlyBump17@reddit

well, the b60 is already out, you can see people saying they have it in hands, but there arent any reliable reviews of it yet. The only "reliable" review is from a russian, but it looks like he used only one b60 for the most of his tests (he used the dual b60 card). You finda find a small set of benchmarks from intel on the mlperf inference 5.1. https://github.com/mlcommons/inference_results_v5.1/tree/main/closed/Intel/results https://youtu.be/mwNMjmICa04

Reply

[-]

Goldkoron@reddit

I got mine for $3000

Reply

[-]

Puzzleheaded-Age-660@reddit

Long term would an RTX Pro 5000 not make more sense since it supports NVFP4

Reply

[-]

m1tm0@reddit

Makes sense for people in sanctioned countries

Reply

Reply to Post

84 Comments