pharrowking

• when did tesla p40s get boost? or did anyone test them on latest moe models?

  Posted by pharrowking@reddit | LocalLLaMA | View on Reddit | 17 comments

• i bought an epyc server with 7642 cpu, and im only getting 0.4 tokens/sec

  Posted by pharrowking@reddit | LocalLLaMA | View on Reddit | 32 comments

• Superscaling like image super resolution but for LLMs

  Posted by pharrowking@reddit | LocalLLaMA | View on Reddit | 9 comments