No, nothing special, just a tiny local language model playing a game it itself wrote.
Posted by DominusIniquitatis@reddit | LocalLLaMA | View on Reddit | 28 comments
"They're just stolen Wikipedia article regurgitators!"
True, brother, true. /s
P.S. Yep, it made it to the score of 10 fairly quickly... in a field that changed the shape after the score of 5.
NoFaithlessness951@reddit
Bro figure out screen recording
DominusIniquitatis@reddit (OP)
Bro I do screen recording. But when your PC is literally crunching at 100%? It's not like recording would be possible there without it lagging like crazy.
(Not to mention I use NVENC, so yeah.)
Anduin1357@reddit
If you have a Ryzen 7000 or 9000 series CPU, you have an additional iGPU media encoder.
If you have an Intel CPU, there is generally Quick Sync.
DominusIniquitatis@reddit (OP)
i7-8700k. Empirically, any type of encoding that involves it is still way laggier/choppier than on the GPU.
Anduin1357@reddit
Have you tried it? Encoding using your iGPU while your GPU is doing work would avoid any resource contention.
DominusIniquitatis@reddit (OP)
Of course I did, otherwise I wouldn't have stated it specifically.
Anduin1357@reddit
Does the iGPU media encode also remain choppy even when you are not running any workload on your GPU?
DominusIniquitatis@reddit (OP)
Honestly, can't remember this specific scenario anymore. What I do remember is that in the past I spent some absurd amount of time trying to get it working smoothly. Maybe there is some arcane ffmpeg-encoder-tuning-fu I'm missing, but NVENC worked simply out of the box, even if it's under moderate-high load. So can't be bothered to investigate this further.
Anduin1357@reddit
Ummm Quick Sync does not use your VRAM. It uses system RAM.
DominusIniquitatis@reddit (OP)
I know. (Maybe there's some misunderstanding?)
Anduin1357@reddit
Are you actually screen recording using raw ffmpeg cli commands tho?
DominusIniquitatis@reddit (OP)
OBS.
Anduin1357@reddit
Yeah, they do have Quick Sync support. Is it bad?
DominusIniquitatis@reddit (OP)
Yep, I know. Based on my experience and my configuration, yes (relatively speaking, as it does record, of course, but the lag is real).
Anduin1357@reddit
Is the resolution and framerate simply too high? Intel's might not be all that capable.
DominusIniquitatis@reddit (OP)
1920x1080, 60 FPS. And thus we return to the fact that NVENC just works without any shenanigans. Now you see where I'm coming from?
Anduin1357@reddit
I mean, I have an RX 7900 XTX and it can do 1440p240 vs my Ryzen 9 9950X3D that does only 1440p120.
Same encoder architecture.
So I'm saying it might not be a software problem. It could just be a lack of hardware oomph.
Puzzled-Guess1181@reddit
what is this tool? how can i run it on my own windows system with a local model?
Octopotree@reddit
Is it having fun?
Sioluishere@reddit
That's not a tiny model!
Tall-Ad-7742@reddit
true its more like a small model i think
i think i would rank it like that
<5B Tiny
<60B Small
<120B Medium
<250B Big
<400B Giant
<1000B Big Brother of Giant
>1000B Terminator who will wipe out humanity if left alone
NoFaithlessness951@reddit
Mistral small 4 (119B) would disagree
Tall-Ad-7742@reddit
xD true
Queasy-Contract9753@reddit
Which model is it?
DominusIniquitatis@reddit (OP)
Qwen 3.6 35B Q4_K_XL.
Queasy-Contract9753@reddit
Solid model. Wouldn't call it tiny but damn good one. Looks pretty quick on your setup too.
DominusIniquitatis@reddit (OP)
RTX 3060. :')
I mean, yes, 35B isn't tiny per se, but let's not forget it's an A3B and the fact that even if it were 35B dense, it's still a droplet in the ocean compared to the "frontier" behemoths.
DominusIniquitatis@reddit (OP)
Yep.