TheaterFire

I just saw something amazing

Posted by ayanami0011@reddit | LocalLLaMA | View on Reddit | 139 comments

I just saw something amazing
https://www.asus.com/displays-desktops/workstations/performance/expertcenter-pro-et900n-g3/ https://www.azken.com/Workstations/nvidia-series/Asus-ExpertCenter-Pro-ET900N-G3?utm\_source=chatgpt.com

Reply to Post

139 Comments

One-Macaron6752@reddit

80k --> gptshop.ai https://preview.redd.it/x0hzt0rfrelg1.jpeg?width=1080&format=pjpg&auto=webp&s=ac34334197ebf69a8cd0af7e85169a521e8a6444
View on Reddit #79173002

JayPSec@reddit

It's now 95k, pre tax.... https://preview.redd.it/omo1vrgclflg1.png?width=577&format=png&auto=webp&s=fbbeb6ace3e5663cf7b0adf9ee57577632c14a42 It doesn't make a lot of sense for the 30/40k ballpark. The interest in selling something like this is capturing a growing market. Being branded I'd imagine it's more expensive and not less. Let's wait and see.
View on Reddit #79180509

gnaarw@reddit

Also wouldn't it be even cheaper to have multiple mac's for that money? Might also get to the same tps or more on multiple agents but for fewer kWh?!
View on Reddit #79253220

MrAlienOverLord@reddit

tps / pp is not even close to that \^\^ not even if you spend 200k im macs
View on Reddit #79309272

gnaarw@reddit

prefill is worse of course. but if you anyways want parallel executions, 4x2 M3 ultras will also give you over 100tps so there's that. Can't finetune on a mac though so only talking inference here..
View on Reddit #79428405

MrAlienOverLord@reddit

now way you get 100 tps on kimi 2.5 - at 4 bit with rdma you get 15 t/s on empty context and thats generation not prefill - cite your source please
View on Reddit #79440905

gnaarw@reddit

I had 20tps on exo in mind?! of course no prefill as I said :D
View on Reddit #79442375

MrAlienOverLord@reddit

moe tp doesnt scale linar .. 20tp's vs 100 you claimed earlier is quiet a difference -> specially with agentic workloads speed is crucial - and yes you pay for it .. a 4x mac cluster sets you back 40k at minium - if you want fast pp you put 8 sparks in front .. -> and now you are at a similar price point .. and still way slower then hbm or the direct scheduling speed of direct access memory via the grace cpu those things dont even compare even if you use exo and have plenty hardware at hand
View on Reddit #79447833

gnaarw@reddit

40k < 80k 🤓 Running agents in parallel is a thing but the very slow prefill probably kills it for most applications 🙂‍↕️
View on Reddit #79658678

One-Macaron6752@reddit

95k USD <===> 80k EUR
View on Reddit #79180574

JayPSec@reddit

good catch :). Still the logic applies
View on Reddit #79181167

MrAlienOverLord@reddit

yet the company is offshore . - so hard to sue if there is something - its literally a guy in his basement - also his accounts getting banned left right and center .. - i would love to order from him .. but that just makes me nauseous - not like the money is spare change .. most work a year or longer for that kind of cash
View on Reddit #79174710

_int10h@reddit

No they are both germans
View on Reddit #79298204

MrAlienOverLord@reddit

which has little impact if you look where there llc is \^\^
View on Reddit #79309205

trapsta@reddit

This copy on their site is sending me: "Why should you buy your own hardware? "You'll own nothing and you'll be happy?" No!!! Never should you bow to Satan and rent stuff that you can own. In other areas, renting stuff that you can own is very uncool and uncommon. Or would you prefer to rent "your" car instead of owning it? Most people prefer to own their car, because it's much cheaper, it's an asset that has value and it makes the owner proud and happy. The same is true for compute infrastructure."
View on Reddit #79176990

Southern_Sun_2106@reddit

How much kidneys?
View on Reddit #79167935

Feeling-Currency-360@reddit

An entire bloodline of kidneys 🤣
View on Reddit #79168100

Snoo-85072@reddit

Woah! I'd never thought about my children's kidneys having that kind of economic value. And they told me I was crazy for having five...
View on Reddit #79177818

OfkMike@reddit

Anybody with 5 kidneys IS crazy.
View on Reddit #79658068

Remarkable-End5073@reddit

All you have 🤣🤣
View on Reddit #79176955

hyllus123@reddit

775gb? If that’s unified usable as NVRam that thing is going to cost south of 100k min. Unreachable but imagine if this becomes commodity- how much more new science and engineering that would unblock
View on Reddit #79553401

undercovernerd5@reddit

$100,000
View on Reddit #79518320

sidonsoft@reddit

one day in the future, your toaster will have one of these chips inside
View on Reddit #79516745

False_Potential@reddit

This kind of machines are maybe good for business or rich boys to show off. Stay cheap, pay for subscriptions, cheap Qwen APIs and stay patient, you never know who will be on top next month.
View on Reddit #79350780

ZealousidealShoe7998@reddit

yeah dell has one too, i think all major brands like msi will have one like this. now how much is gonna cost is the interesting part. a mac m3 ultra 512 is 10k a rtx pro 6000 is 6-8k so probably 10k for a full system if you already own memory . if this is like 10k it's gonna be the new prosumer hardware
View on Reddit #79170820

IkHaatUserNames@reddit

When I talked to a Dell sales rep a few months ago they said somewhere between 25-35k, this was before spike in ram prices. So probably north of 40
View on Reddit #79172644

_int10h@reddit

If its 35k I would buy it
View on Reddit #79298326

ZealousidealShoe7998@reddit

make sense, let's time i checked lambda for a good machine it was in between 40-60k .
View on Reddit #79173876

Conscious-Ball8373@reddit

Someone further up has a link to preorder at EUR80k with 775GB. 10k hahahaha
View on Reddit #79196409

trackktor@reddit

Quadruple that, at minimum. You’re day dreaming
View on Reddit #79173039

ZealousidealShoe7998@reddit

one can hope. it's gonna be great when in a few years when these boxes gonna be a lot cheaper because we either had a software breakthrough or hardware breakthrough so this wont be the latest and greatest. right now this is the size of a regular desktop which most people are well faimiliar with but with server grade hardware this should be very very interesting for big companies as workstations so yeah i can see it being 40-60k . still a lot cheaper than a 250k server that needs 100k in infra to run .
View on Reddit #79174085

VortexSheets@reddit

This may lead to the next mortgage crisis, as it will require tapping into the HELOC loans.
View on Reddit #79260030

Proparser@reddit

How much?
View on Reddit #79166613

Turbulent_Pin7635@reddit

People are guessing 50k, but I truly doubt it. I would guess something ~120-150k. That beast can easily be an AI server for the top tier local models for whole teams in small companies. For personal use, unless you are rich 🤑, I still prefer (for cost efficiency) the Mac studio. 9k packed with silence and small electric bills.
View on Reddit #79255017

gnaarw@reddit

The second link said "from 0 USD" so maybe they do offer organ options ✌🏻
View on Reddit #79252945

gekx@reddit

If you have to ask, you can't afford it
View on Reddit #79166928

ZunoJ@reddit

This is like 1st gen rich vs 3rd gen rich. 1st gen can be as rich as they want, they will still care about how much something costs, 3rd gen acts like u/gekx
View on Reddit #79175614

bityard@reddit

1st gen rich got rich precisely because they were careful what they spent
View on Reddit #79184389

ZunoJ@reddit

Yeah, thats why I said it
View on Reddit #79184700

triynizzles1@reddit

This is like $100k+ right?
View on Reddit #79165928

claythearc@reddit

Not 100. A B300 is only $35k list, depending on the rest of the build it’s probably in the 50s
View on Reddit #79168761

arstarsta@reddit

B300 only have 144gb memory right?
View on Reddit #79172981

LabLiving399@reddit

This should have 192GB of fast VRAM and the rest should be connected via NVlink, so not slow too.
View on Reddit #79247365

devilish-lavanya@reddit

Yes, Only?
View on Reddit #79183032

Caffdy@reddit

> A B300 is only $35k list where? im curious
View on Reddit #79211278

claythearc@reddit

You have to vibe math off listings of like 8 unit servers since the individual GPUs aren’t sold currently but it lines up with Jensen’s comments last year? I think? for their expected price range.
View on Reddit #79212742

devilish-lavanya@reddit

And a B200 bomber?
View on Reddit #79183016

triynizzles1@reddit

weren’t previous gen DGX systems $80,000?
View on Reddit #79170368

az226@reddit

$120k.
View on Reddit #79180683

az226@reddit

$40k is B100. This is a GB300.
View on Reddit #79180667

01010110_@reddit

Probably around $50k-$80k
View on Reddit #79166973

hainesk@reddit

The CD-ROM drive is a nice touch.
View on Reddit #79165521

jcrestor@reddit

They know their target groups: guys in their late 40s / early 50s who have been “building“ their PCs since the 90s and now have much disposable income and have found a new hobby.
View on Reddit #79171669

trackktor@reddit

Probably $100k. It’s not the target group you’re describing
View on Reddit #79173135

bittabet@reddit

I know a couple of guys like this though, it’s usually a relatively technically knowledgeable guy who’s more or less made it (i.e. has a multimillion dollar home already and a few nice cars) and since they love tech stuff they’ll sometimes spring for something top of the line to play around with whatever the latest thing is. Both of the guys I know make multi 7 to 8 figures per year so if you’re wondering what kind of guy would spend this kind of money on a six figure tech product that’s the kind of guy.
View on Reddit #79246343

Comrade-Porcupine@reddit

So I'm one of these early 50s guys terrifyingly describes in the parent comment, and I tend to have a little more disposable money for, uh, hobbies, but. For me this would be a choice between a new roof and/or kitchen and this machine. Pretty sure I'd choose the former.
View on Reddit #79188747

jcrestor@reddit

Yeah, I agree the price tag is a little bit steep. So I might have to concede this point 🫣
View on Reddit #79190726

MrAlienOverLord@reddit

not just prob. gptshop has them listed at 95k starting
View on Reddit #79174590

FormerKarmaKing@reddit

The F-150 Lightning of computers
View on Reddit #79189582

Billthegifter@reddit

How else will I Install my copy of Windows 98 from the CD. Think.
View on Reddit #79214718

timbo2m@reddit

Gotta put your cup somewhere
View on Reddit #79170720

Sufficient-Past-9722@reddit

Heh, I think they're using a different photo from the Asus site, but I've actually just been burned today by a case without support for 5.25" bays. I got an icydock U.3 cage without realizing my case has none. Now it's sitting at the bottom hanging loose next to the PSU. Thermals are great though!
View on Reddit #79166975

FriskyFennecFox@reddit

[For the Bosnian users out there!](https://www.reddit.com/r/aiwars/s/lkStDOqIUb)
View on Reddit #79165747

jermvirus@reddit

Will I get 240 FPS on COD?
View on Reddit #79235319

Pbook7777@reddit

Prob have to run a 100amp line to power it…
View on Reddit #79229324

East_Coast_3337@reddit

Looks like my electric deep fryer, rotated 90 Degrees: https://www.thespruceeats.com/product/?url=https%3A%2F%2Fwww.amazon.com%2FBreville-BDF500XL-Smart-Fryer
View on Reddit #79220484

ataylorm@reddit

For the same price you code get 4 Mack studios with 2tb total memory
View on Reddit #79181254

Shinkai_I@reddit

with 800Gb/s bandwidth
View on Reddit #79185119

Caffdy@reddit

if you use anything over the 279GB of the B300, you're gonna get bottle necked to system RAM speeds anyway
View on Reddit #79219095

Potential_Block4598@reddit

WTH ?! How much does this thing cost ? It basically can run a full Kimi 1T at Q4 or even higher It basically can run anything
View on Reddit #79168367

MrAlienOverLord@reddit

100k the box - even if you spend 2k a month in inference - which is almost impossible at such a cheap model that wont pay it self off in 3 years - and by then models are 10x bigger again .. let alone the power cost
View on Reddit #79174929

jeekp@reddit

im not counting on api pricing staying this cheap for much longer
View on Reddit #79212014

MetaTaro@reddit

As various manufacturers have released derivatives of DGX Spark, this would be a derivative of DGX Station as well. [https://www.nvidia.com/en-us/products/workstations/dgx-station/](https://www.nvidia.com/en-us/products/workstations/dgx-station/)
View on Reddit #79168253

bourbonandpistons@reddit

The spark is four times slower than even just a 5090. It just has a larger memory as a benefit
View on Reddit #79211013

Iterative_One@reddit

Want it but can't afford it.
View on Reddit #79205077

Darklumiere@reddit

The look reminds me of the Mac Pro 4,1, though this is probably 100 times more powerful lol https://preview.redd.it/230id5309hlg1.jpeg?width=768&format=pjpg&auto=webp&s=80f74340134fa99978f1446d1275b3910ffa4d3e
View on Reddit #79204108

Pro-editor-1105@reddit

Only for $640845684509645645645.67
View on Reddit #79165611

SodaBurns@reddit

I will pay you 100 bucks now and the rest when we achieve AGI in ~5 years.
View on Reddit #79166870

Pro-editor-1105@reddit

OK give me my hundo then..
View on Reddit #79168681

arcanemachined@reddit

OK, now just pass it over to me...
View on Reddit #79172306

gjallerhorns_only@reddit

We raised GDP by $200!
View on Reddit #79203692

No_Indication_1238@reddit

Send your intern with the rest on the morrow.
View on Reddit #79169669

MaximKiselev@reddit

Did you foget!? Only today -0.99!
View on Reddit #79203081

Fywq@reddit

Meh - The way things in the world, we probably won't be around when I (don't) reach pension age. Might as well just go all in now.
View on Reddit #79179371

richardathome@reddit

\*RAM extra
View on Reddit #79174556

slyticoon@reddit

If it's less than 30 grand, it's gonna be a great offering.
View on Reddit #79203393

SpicyWangz@reddit

775GB of coherent memory. Just imagine how much incoherent memory they must have packed in there then!
View on Reddit #79165563

mxforest@reddit

That's what the buyer is for.
View on Reddit #79167253

RestInProcess@reddit

It will eventually happen to us all
View on Reddit #79198679

Majestic_Wrap_7006@reddit

This hits too close to home.
View on Reddit #79171727

ibhoot@reddit

Your not making sense 🤐
View on Reddit #79189460

Majestic_Wrap_7006@reddit

Seems 16 (upvotes) redditors would say I do. What makes you think I don't?
View on Reddit #79192354

mxforest@reddit

Just like the mortgage, once you buy this thing.
View on Reddit #79171835

StardockEngineer@reddit

I have the supply of incoherent memory locked down, according to my wife.
View on Reddit #79186659

Reasonable_Day_9300@reddit

Internet winner of today ☝️
View on Reddit #79170122

Kerem-6030@reddit

WE ALL OF US NEED THİS
View on Reddit #79197592

djstraylight@reddit

Guesses are about $70,000-$80,000 for the 775 GB memory version. Maybe $40K with less memory?
View on Reddit #79167101

RIP26770@reddit

But 775 GB is already short....
View on Reddit #79171728

dbenc@reddit

640k ought to be enough
View on Reddit #79189644

Conscious-Ball8373@reddit

We are already past the point where "640GB should be enough memory for anyone..."
View on Reddit #79196222

No_Afternoon_4260@reddit

What nobody dares to say
View on Reddit #79175922

1ncehost@reddit

Tdp of 1 gb300 is 1400 watts, so this thing will need its own breaker at home.
View on Reddit #79195873

xrvz@reddit

Already "unveiled" 7 months ago: https://videocardz.com/newz/asus-quietly-introduces-expertcenter-desktop-powered-by-nvidia-gb300-grace-blackwell-ultra Maybe it'll be launched in another 6 months (but be sold out), and you can actually buy one in 10 months for the price of a BMW i9.
View on Reddit #79193530

JohnSnowHenry@reddit

Bought two!
View on Reddit #79192211

Turkino@reddit

And I bet somehow it's already sold out
View on Reddit #79192094

6969its_a_great_time@reddit

Open source Software support for these is ass
View on Reddit #79189814

Remarkable-End5073@reddit

Well, a minisforum ms-s1(only $2000) will be good enough to run LLMs locally.
View on Reddit #79177088

spaceman3000@reddit

I have it. It's good but slow as hell. Mac studio is the best option today
View on Reddit #79185855

Remarkable-End5073@reddit

On that, we agree! The question is buying a Mac Studio for $10000+ just for dev isn’t quite cost-efficiency. I really hope it can make some money for me.
View on Reddit #79187277

spaceman3000@reddit

I don't even code, I'm just self-hosting guy so I love to run everything locally. Strix is great for loading lots of smaller models at the same time but for dense ones yeah memory bandwidth is too narrow. For the price you can't get anything better but I regret not netting 96GB Mac instead (yeah double the price) but I wasn't sure if I'm going to be sucked into llm world. I am though so now just waiting to see if apple is going to release m4 ultra or something in m5 line and gonna get one.
View on Reddit #79187527

taoyx@reddit

How does this compare to a Mac Studio M3 Ultra with 512Gb RAM and 80 GPUs?
View on Reddit #79183915

spaceman3000@reddit

Mac studio eats it for breakfast
View on Reddit #79185720

AwayLuck7875@reddit

Big toys
View on Reddit #79171371

squareOfTwo@reddit

for big guys with big pockets
View on Reddit #79180934

BloodOnyxx@reddit

Electricity Bill mmmmmmmmmmmmmmmmmmmmmmmmmmmm
View on Reddit #79180469

pharrowking@reddit

https://preview.redd.it/is4rwr79kflg1.png?width=2201&format=png&auto=webp&s=9014d87578d8d8ce4f5f48c72ff29991120e230a gigabyte has one too
View on Reddit #79180124

_gonesurfing_@reddit

I hope this doesn’t use Jetpack.
View on Reddit #79180108

Fywq@reddit

>PCB color and bundled software versions are subject to change without notice. At the expected pricetag I am not going to accept deviations to something as critical as PCB color - This is absolutely not acceptable!
View on Reddit #79179508

DertekAn@reddit

No thanks, my 16GB graphics card is enough, haha... Joking aside... But that would be way too expensive for me.... Just wow! 😵‍💫😵‍💫😵‍💫😵‍💫💜
View on Reddit #79177977

Imakerocketengine@reddit

Do we have an estimation of $/gb ?
View on Reddit #79177387

Vozer_bros@reddit

this machine could power GLM-5 6 bit perfectly https://preview.redd.it/ruzhe4m2uelg1.png?width=990&format=png&auto=webp&s=04c28e3e0d379751487bcff3ca600d1e0f4c89d3
View on Reddit #79173619

No_Afternoon_4260@reddit

On 288 blazing fast vram, the rest on slowish lpddr5x
View on Reddit #79175946

Vozer_bros@reddit

ahh, so it is not like Apple unified memory
View on Reddit #79176156

No_Afternoon_4260@reddit

No it's better you have 288gb of 8to/s vram with real compute, not 800gb/s with (so far) poor compute
View on Reddit #79176230

Vozer_bros@reddit

thanks bro, me clearly continue to have more coding subs
View on Reddit #79176300

No_Afternoon_4260@reddit

Lol ur welcome
View on Reddit #79176321

webprofusor@reddit

Isn't it 228 tokens/sec. I'm hoping we'll see many more efficient approaches like the 17k tokens/sec suggested by [https://taalas.com/products/](https://taalas.com/products/)
View on Reddit #79170853

MrAlienOverLord@reddit

the problem with taalas is that the model is burned in hardware .. and a decent sized model needs 30 + chips .. now .. you cant change the model - you need a rack to run it . where the power costs you 5x as much as inference would cost you - and given they litho the metal layers specially for your model .. you need n\^2 + 1 redundancy .. as if 1 chip breaks your whole cluster goes down .. wafer in the fab takes about 3 months - so till that is packaed and you get it its 6 months old or older - maybe its something in 5-10 years when we all collapsed to 1 model - but so far i can only see that working in finance / gov / gas-oil - not for hyperscalers in llms -
View on Reddit #79174824

webprofusor@reddit

Yeah I agree, hopefully there will be a middle ground developed that takes the best overall architecture. The current GPU solution doesn't seem to be cutting it and the TPU thing seems to have remained within the reach of only a select few.
View on Reddit #79175626

MrAlienOverLord@reddit

my bet is on matmul acceleration in photonics as a coprocessor once we can copackage solid state lasers (galium arsendite) - photons dont get hot unlike electrons .. - and we can push a systolic array as fixed configuration in waveguides - additonaly the fab process can be done pretty much anywhere .. as that gear from the late 80's is good enough for those feature sizes / side effect is that we can multi spectra emit and push the bandwidth that way - i mean .. its robust already .. as thats how the internet works in the end of the day - and we process pb's of data every that way .. just needs to be shrinked and copackaged .. the problem with custom fixed hardware is that they are bulky and you need many of them - masks are expensive - if you need to spend 20-50mil on a 1 unit of scale with lowest redundancy for something that lasts you 3 months - good luck .. and its not infinite batching either - groq has similar issues with there inference systems - if there are many users -> they are cooked - thats why its overall hardly faster then gpu's its always a tradeoff in flexibility .. if you spend 400k on a b200 box / 4.2 mil on a nvl72 rack and remain flexible .. or go for speed which has 0 chance of useage over 3-5 years as imageing you have to use llama 1 for everything today
View on Reddit #79176291

Cultured_Alien@reddit

228 tokens/sec for 8B?
View on Reddit #79170984

MrAlienOverLord@reddit

they are around 95-100k like every dgx work-station scan has them in the uk - waiting for the rep to call to tell me exact priceing
View on Reddit #79174553

Prestigious-Use5483@reddit

...and then I saw the price 😭
View on Reddit #79174511

neuralnomad@reddit

This here is giving all the cheesegrater Mac Pro vibes of 2909, where’s my parmesan wheel ? 😆 (Peering at the bc ports best i can with zoom, do I see FW800 ports too?!! *swoons*}
View on Reddit #79174064

Revolaition@reddit

Any word on pricing?
View on Reddit #79170966

MadwolfStudio@reddit

Do you need to be plugged into the citys main power to get this thing running? And does it then increase the ambient temperature of surrounding neighbourhoods??? Jesus Mary have mercy
View on Reddit #79170734

Terminator857@reddit

Let me sell my house so I can buy two.
View on Reddit #79170461

ManufacturerWeird161@reddit

ASUS finally shipping a Xeon W-3400 + RTX 6000 Ada box with 2TB RAM support out of the box? That's the kind of no-compromise workstation config I'd normally only expect from BOXX or Puget. Curious how the thermals handle dual 350W GPUs in that 27L chassis though.
View on Reddit #79167577

chensium@reddit

GB300.  Sure no problem.  Lemme just first win the lottery a few times so I have enough cash for the down payment
View on Reddit #79165949