ClimateBoss

• Which multi GPU for local training? v100, MI50, RTX 2080 22gb?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 6 comments

• How to do Batching in Llama.cpp ? Speed goes down LOL?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 8 comments

• How do I figure out -b batch size to increase token speed?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 4 comments

• Training on 8x v100 32GB with NVLink or 2x RTX Pro 6000?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 1 comments

• llama.cpp takes forever to load model from SSD?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 18 comments

• Ubuntu or Debian? Speed difference on llama.cpp tokens?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 8 comments

• Best GPU for $250? NVIDIA P40 or MI50 32gb?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 16 comments

• Is Qwen3.5 35b and 122b better than Qwen3 Coder Next 80b at Coding?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 1 comments

• How to Prompt Caching with llama.cpp?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 13 comments

• How do I use Claude Agent Swarm but Locally?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 4 comments

• Qwen3 Coder Next.gguf .... or .... Claude?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 7 comments

• How to do this locally?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 6 comments

• Tensor parallel on old GPUs? ik_llama only way?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 5 comments

• On Prem SQL and Web App on AWS? Use Cloudflare Tunnel yay or nay?

  Posted by ClimateBoss@reddit | sysadmin | View on Reddit | 4 comments

• How do I turn off CPU for llama.cpp?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 4 comments

• Best agentic Coding model for C++ and CUDA kernels?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 18 comments

• What is llama.cpp equivalent for image & video gen?

  Posted by ClimateBoss@reddit | LocalLLaMA | View on Reddit | 16 comments