What’s the fastest, smallest, smartest LLM today? (3b or less)

Posted by triplepicklepants@reddit | LocalLLaMA | View on Reddit | 89 comments

Hate to ask a generic question, but information on LLMs seem to change weekly. is Phi-3 the answer? I have a mid range PC, GTX 1660 super, 6gb vram, ryzen 5 5600. I’m trying to go for near instant (slight exaggeration) sentence or short paragraph outputs. Are we there yet or am I too optimistic?