Judtoff

• X99 huananzhi f8d PLUS PCIE spacing vs 3090 Blower cards

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 10 comments

• Mistral Large 2407 Speculative Decoding issues on llama.cpp

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 5 comments

• Deepseek Distill of Mistral Large?

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 3 comments

• Useful P State tool for P40 owners

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 1 comments

• 3x P40 crew running llama.cpp, are you seeing a speed-up with speculative decoding?

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 22 comments

• Has anyone figured out how to run the new llama 3.2 vision models on P40 cards?

  Posted by Judtoff@reddit | LocalLLaMA | View on Reddit | 1 comments