llama.cpp - NVFP4 native support on Blackwell from now - b8967

Posted by mossy_troll_84@reddit | LocalLLaMA | View on Reddit | 34 comments

It looks like finally we have it! Time to test!!!
https://github.com/ggml-org/llama.cpp/releases/tag/b8967