Here is a powershell script to determine gpulayers parameter for KoboldCPP.

If you use KoboldCPP and models that do not completely fit into your GPU memory, and you wonder how many layers you can offload to GPU, [here is](https://gist.github.com/Barafu/cd65b0eefc360a30d0d5a9aad450fe0e) a simple Powershell script that would find it for you. Or if you wonder how many layers can you have on GPU while also running StableDiffusion, then start SD first, and this script after. Read the instruction carefully, dragons included. Feel free to ask questions here, or, better yet, on GitHub.