Just upgraded my RTX 3060 with 192GB of VRAM
Posted by Wrong_User_Logged@reddit | LocalLLaMA | View on Reddit | 84 comments
Soldered in some extra memory chips I had lying around. Runs now Deepseek R1 with 1.6 bits at 8 t/s.
Posted by Wrong_User_Logged@reddit | LocalLLaMA | View on Reddit | 84 comments
Soldered in some extra memory chips I had lying around. Runs now Deepseek R1 with 1.6 bits at 8 t/s.
GreatGatsby00@reddit
Is this an April fool's joke, because I didn't think it was that easy.
No-Refrigerator-1672@reddit
Dude, you clearly did something wrong. My upgraded 3060 can do 20 tok/s. Check your soldering, there must be a bad joint causing singal integrity issues and reduced memory clocks.
frivolousfidget@reddit
Maybe it is bad joint is leaking memory
terriblysmall@reddit
Solder some ram onto the joint to stop the leak
frivolousfidget@reddit
What color should we use? I heard mauve has the most ram.
tafadzwad@reddit
Classic mistake - mauve does have great ram, but periwinkle has better multithreading. If you're optimising for speed, though, chartreuse is overclockable (just watch out for overheating).
MrFireWarden@reddit
This guy periwinkles
Wrong_User_Logged@reddit (OP)
my tokenizer is broken
No-Refrigerator-1672@reddit
Then what are you waiting for, solder some more ram to your tokenizer!
brightheaded@reddit
This is the way
AlarmingProtection71@reddit
This is the way
Dependent_Ad948@reddit
This this is the way is the way.
_-inside-_@reddit
This is the way is the way is the way is the way
somethedaring@reddit
lol!
Low-Opening25@reddit
Considering the date, the this totally checks out.
Evening_Ad6637@reddit
What the hell? I have been mentally preparing myself for a week now not to be tricked on this day and yet it has just happened. My wishful thinking has given my objectivity a real knockout blow. 🤣
Own-Exit1083@reddit
Tbh in your case it sounds like a bit loss of mental processes. Did you hit your head recently during work or personal times?
10minOfNamingMyAcc@reddit
Reddit trolling me a day after like usual.
daynighttrade@reddit
Thank you for this. My dumb mind was wondering how is it possible, and thinking if I can try it myself
Cyclonis123@reddit
Ive always hated this day...
Inner-Discount2973@reddit
Me too lol, I was like, can we really solder ram on the gpu ? haha
half_a_pony@reddit
We can and people have done it but there’s a limit of how much memory can be on one memory chip. This depends on DRAM tech, at some point it just doesn’t fit in package. Of course tech evolves so we may see bigger chips in future but for now you can’t fit this much on this board.
h2g2Ben@reddit
I fucking hate today on the internet.
KeemstarSimulator100@reddit
2nd of April where I live :P
LilPsychoPanda@reddit
God damn it! Can’t trust anything today 😅
sleepy_roger@reddit
😂 glad I saw this was going to ask if OP takes orders
Aat117@reddit
Ah rip, I just got a bunch of V100's. Could have saved a bunch of money with this :(
Ok_Top9254@reddit
Dang, aren't they like 1500$ on ebay per unit?
Aat117@reddit
Yeah, though I got them for less (work)
GTHell@reddit
“Sooldered in some extra memory chips I had lyring around” 🥹
Sinphaltimus@reddit
For those who got fooled yesterday, try finding this today. Lol SMH. I should have known better
croholdr@reddit
wtg ^5
thejacer@reddit
Dammit you got me.
TheColonelJJ@reddit
You're kidding, right?
Wrong_User_Logged@reddit (OP)
no it's 100% legit and tbh quite easy, I'll publish detailed tutorial this afternoon
Hearcharted@reddit
It is way easier to just download more VRAM 🥳
Lazy-Chick-4215@reddit
I'm running llama 405GB on a potato.
_-inside-_@reddit
Vegetable AI is the way to keep the industry green and sustainable.
SerbianCringeMod@reddit
I'm running on actual llamas
Lazy-Chick-4215@reddit
LOL
Smile_Clown@reddit
That explains all the shitty UFO videos on the internet. Pick a hobby bud.
throwaway2676@reddit
Is it named GLaDOS?
MoffKalast@reddit
You need to find a better hostname for your DGX station.
AppearanceHeavy6724@reddit
I run V3 0324 on an onion.
Sindre_Lovvold@reddit
How many layers is that?
GambAntonio@reddit
Depends on the ogre
AppearanceHeavy6724@reddit
That is a good question. I have offloaded 5-6 to my stomach, about twice that is left.
Commercial-Celery769@reddit
Shit I did this to my 750 ti. Was only able to fit 96GB vram though.
Thebombuknow@reddit
Rookie numbers. I upgraded my i386SX machine with 2TB of GDDR12X, and it can run two DeepSeek-R1 prompts at once at 100T/s
Narpesik@reddit
i actually believed that untill i opened comments, oh no...
Intrepid_Traffic9100@reddit
Quality April fools joke, took me longer to realize than I am proud to admit
Actual-Lecture-1556@reddit
Falling every fucking year for it hahaha
HumidFunGuy@reddit
You could have just downloaded more RAM for free at Download More RAM then used Python12.4 to convert it to usable VRAM
I hope others can learn from your mistakes.
Automatic_Hornet_628@reddit
Is this april fools? But for real Im missing something?
Ruin-Capable@reddit
Lord I hate April 1.
DehydratedButTired@reddit
Dude, so many people are sharing this right now in a serious manner.
edernucci@reddit
Your card seems to be really sexy. Are you using GDDR6XXX?
kharzianMain@reddit
Amazing, if it runs a little bit consider a little water fountain it works wonders
One-Employment3759@reddit
April 1 is regarded
angry_queef_master@reddit
Lemme look through my drawer to see if I have any spare VRAM modules
Electronic-Metal2391@reddit
I installed a VRAM Boosting Software "VRAM BOOSTER", on my RTX3050, upgraded it from 8GB to 96GB.
vamshi_01@reddit
🤣🤣🤣😅
Snoo_28140@reddit
This is funny, but too often april fools content ends up polluting search results year round
Wrong_User_Logged@reddit (OP)
and also messing up with models' training 😁
Snoo_28140@reddit
Lol
swagonflyyyy@reddit
April fools....jerk
YearnMar10@reddit
He clearly added /s at the end.
MoffKalast@reddit
You are technically correct, the best kind of correct.
master-overclocker@reddit
I cant wait for April 2nd ... Sick of this troll posts ...😏
PassengerPigeon343@reddit
I just need to sign off for today
maddogawl@reddit
I upgraded mine to 193GB of VRAM!
Sdoofette@reddit
April Fool?
Round-Instance-411@reddit
You suck. That is all.
Vaddieg@reddit
you can easily bump it to 512GB by stacking memory chips. Use sand paper to remove top layer of chip packaging and expose expansion pins
Specialist_Ruin_9333@reddit
Username checks out
VonLuderitz@reddit
!ban
maxigs0@reddit
At least put some effort into april fools ...
Wrong_User_Logged@reddit (OP)
you are here, so you clicked 😛
ready_to_fuck_yeahh@reddit
Noob, I just downloaded RAM and using it
AlbeHxT9@reddit
Sorry for the "joke over my head" nerd comment, but i'd love to say that it is actually possible to "download" ram mounting google drive as a partition and use that partition as swap memory
hurrdurrmeh@reddit
You had for a while. Because I WANT TO BELIEVE.
Good touch with the believable t/s.
nail_nail@reddit
My 486sx is also kind of the same speed, weird..
iamlazyboy@reddit
Rookie numbers, I had a 7900xtx with 1TB of VRAM and upgraded my system RAM to 2TB RAM, I now run a copy of the latest CHATGPT at 10tokens a second with 200k context no problem
Greedy-Lynx-9706@reddit
"you had lying around"?