Ueberlord

• [llama.cpp] Asymmetric KV q8/q4 cache: current caveats and discussion in GGML repo

  Posted by Ueberlord@reddit | LocalLLaMA | View on Reddit | 27 comments

• OpenCode concerns (not truely local)

  Posted by Ueberlord@reddit | LocalLLaMA | View on Reddit | 185 comments

• [Paper] Residual Streams / KV Direct

  Posted by Ueberlord@reddit | LocalLLaMA | View on Reddit | 6 comments