Where is theBloke?
Posted by holistic-engine@reddit | LocalLLaMA | View on Reddit | 35 comments
Haven’t seen any posts related to this legend in a while? Where is he, is he okay?
Posted by holistic-engine@reddit | LocalLLaMA | View on Reddit | 35 comments
Haven’t seen any posts related to this legend in a while? Where is he, is he okay?
ozzeruk82@reddit
I just look forward to reading a book about the history of LLMs in like 2050 and there will be a paragraph going something like "during the halcyon days of 2023 hoardes of early adopters would be on tenterhooks waiting for a user known as 'theBloke' to release 'quantized' versions of new models that they could more easily run on their home computers".
my_name_isnt_clever@reddit
Interesting that you think quantized would need to be in quotes. By then I think AI quants will be common enough to be a known word for technical people.
MrPecunius@reddit
If you have half a petabyte of 100TB/sec RAM, you won't need to quantize anything.
YearZero@reddit
If I have 100TB/sec in an implant, I'd be running 10T param models at 10 t/s. At Q4 might get 20t/s. And I'd be excitedly awaiting the implant that can do 300TB/s and bigger models of course.
my_name_isnt_clever@reddit
You do if the model is much much bigger than that. “640K ought to be enough for anybody.”
ozzeruk82@reddit
Yeah I did think twice about that! I guess in my mind the book wasn't a technical book as such. Though by 2050 maybe things have advanced so much that we don't need to quanitise big models any more.
my_name_isnt_clever@reddit
To me it feels similar to a term like 'URL'; most people don't know what it stands for and might be confused out of context, but they kinda know what they are because it's impossible to use the internet without them.
It's an interesting thought experiment.
Entubulated@reddit
TheBloke was apparently working from a grant. It ended, he stopped.
Kwigg@reddit
It's just weird that he disappeared off the face of the earth though. One day he was an active (and downright pivotal) member of the community, and literally overnight he vanished without a trace.
Slight-Edge8295@reddit
People will harass you constantly if you stick around. It's probably best for their mental health to disappear.
Kwigg@reddit
Wouldn't have been any harder for him to say he was done before doing the disappearing act. He built an ecosystem with himself as the central repository of quants, it took several weeks for people to accept he wasn't coming back and start making alternative arrangements.
Slight-Edge8295@reddit
Just a reminder that we owe you nothing.
Kwigg@reddit
Also costs nothing to be decent. I appreciate the nice gotcha comment reply, but it does nothing to refute the fact that things would have been better off for the community had he handled it differently.
Slight-Edge8295@reddit
At the end of the day, and whether you like it or not - the community is irrelevant.
vibjelo@reddit
No, not that weird, fairly common in software/FOSS that people work on things that interest them until it no longer interest them for one reason or another, and then they disappear and stop working on it. Part of a healthy ecosystem that people come and go :)
TrashPandaSavior@reddit
If you gotta go, go out on top.
swagonflyyyy@reddit
So he didn't disappear with Elvis!
holistic-engine@reddit (OP)
We should make a gofundme for him lol
Minute_Attempt3063@reddit
What if he doesn't want that though?
Money might not have been the issue after he got those resources.
It's motivation. And after his grant was done, he stopped. Which is his wish. This is kind of normal in open source
bigattichouse@reddit
Could also be a "Thank you for moving the entire community forward, why don't you take a nice vacation, or pay off your car, or house, or something"
Specialist-Ad2870@reddit
thebloke reddit account spotted lmao
bigattichouse@reddit
hardly - I'm running a P2200 GPU and 128GB of CPU ram.. I'm barely able to run 32B models with CPU offloading.
redditscraperbot2@reddit
That's honestly completely reasonable. Making quants is simple but fairly resource intensive.
HenkPoley@reddit
He started his own company at the time he stopped quantising models.
molbal@reddit
Let's not doxx him
3j141592653589793238@reddit
I had an interview with him at a company where he's the CTO. He's fine, just busy.
HyperionTone@reddit
FoxyAI?
3j141592653589793238@reddit
I think you should delete this, he's not making it public for a good reason
HyperionTone@reddit
It has been a rumour for quite some time here. Nothing new. But I guess that confirms it!
redditscraperbot2@reddit
His will to make new quants is completely bloken.
silenceimpaired@reddit
Unsloth fills the role quite well these days
Betadoggo_@reddit
Around the time he disappeared I recall someone affiliated with a VC saying he was setting up a company and he'd be back with something soon, so my personal headcanon is that he exit scammed a VC, a true legend.
metamec@reddit
Maybe he's finally met theSheila and has no time for us anymore.
No_Afternoon_4260@reddit
This is the way
Glittering-Dig-425@reddit
He will be remembered... forever