Pancake502

• Llama.ccp

  Posted by Pancake502@reddit | LocalLLaMA | View on Reddit | 22 comments

• Mac mini M4 24GB - what models can I run?

  Posted by Pancake502@reddit | LocalLLaMA | View on Reddit | 13 comments

• How to serve vllm Qwen2.5-32B AWQ on a single RTX 3090?

  Posted by Pancake502@reddit | LocalLLaMA | View on Reddit | 10 comments