No, nothing special, just a tiny local language model playing a game it itself wrote.

Posted by DominusIniquitatis@reddit | LocalLLaMA | View on Reddit | 28 comments

"They're just stolen Wikipedia article regurgitators!"

True, brother, true. /s

P.S. Yep, it made it to the score of 10 fairly quickly... in a field that changed the shape after the score of 5.

[-]

DominusIniquitatis@reddit (OP)

Bro I do screen recording. But when your PC is literally crunching at 100%? It's not like recording would be possible there without it lagging like crazy.

(Not to mention I use NVENC, so yeah.)

[-]

Anduin1357@reddit

If you have a Ryzen 7000 or 9000 series CPU, you have an additional iGPU media encoder.

If you have an Intel CPU, there is generally Quick Sync.

[-]

DominusIniquitatis@reddit (OP)

i7-8700k. Empirically, any type of encoding that involves it is still way laggier/choppier than on the GPU.

[-]

Anduin1357@reddit

Have you tried it? Encoding using your iGPU while your GPU is doing work would avoid any resource contention.

[-]

DominusIniquitatis@reddit (OP)

Of course I did, otherwise I wouldn't have stated it specifically.

[-]

Anduin1357@reddit

Does the iGPU media encode also remain choppy even when you are not running any workload on your GPU?

[-]

DominusIniquitatis@reddit (OP)

Honestly, can't remember this specific scenario anymore. What I do remember is that in the past I spent some absurd amount of time trying to get it working smoothly. Maybe there is some arcane ffmpeg-encoder-tuning-fu I'm missing, but NVENC worked simply out of the box, even if it's under moderate-high load. So can't be bothered to investigate this further.

[-]

Anduin1357@reddit

Ummm Quick Sync does not use your VRAM. It uses system RAM.

[-]

DominusIniquitatis@reddit (OP)

I know. (Maybe there's some misunderstanding?)

[-]

Anduin1357@reddit

Are you actually screen recording using raw ffmpeg cli commands tho?

[-]

DominusIniquitatis@reddit (OP)

OBS.

[-]

Anduin1357@reddit

Yeah, they do have Quick Sync support. Is it bad?

[-]

DominusIniquitatis@reddit (OP)

Yep, I know. Based on my experience and my configuration, yes (relatively speaking, as it does record, of course, but the lag is real).

[-]

Anduin1357@reddit

Is the resolution and framerate simply too high? Intel's might not be all that capable.

[-]

DominusIniquitatis@reddit (OP)

1920x1080, 60 FPS. And thus we return to the fact that NVENC just works without any shenanigans. Now you see where I'm coming from?

[-]

Anduin1357@reddit

I mean, I have an RX 7900 XTX and it can do 1440p240 vs my Ryzen 9 9950X3D that does only 1440p120.

Same encoder architecture.

So I'm saying it might not be a software problem. It could just be a lack of hardware oomph.

[-]

Puzzled-Guess1181@reddit

what is this tool? how can i run it on my own windows system with a local model?

[-]

Octopotree@reddit

Is it having fun?

[-]

Sioluishere@reddit

That's not a tiny model!

[-]

Tall-Ad-7742@reddit

true its more like a small model i think

i think i would rank it like that

<5B Tiny
<60B Small
<120B Medium
<250B Big
<400B Giant
<1000B Big Brother of Giant
>1000B Terminator who will wipe out humanity if left alone

[-]

DominusIniquitatis@reddit (OP)

Qwen 3.6 35B Q4_K_XL.

[-]

Queasy-Contract9753@reddit

Solid model. Wouldn't call it tiny but damn good one. Looks pretty quick on your setup too.

[-]

DominusIniquitatis@reddit (OP)

RTX 3060. :')

I mean, yes, 35B isn't tiny per se, but let's not forget it's an A3B and the fact that even if it were 35B dense, it's still a droplet in the ocean compared to the "frontier" behemoths.

[-]

DominusIniquitatis@reddit (OP)

Yep.