Red_Redditor_Reddit

• WTF are these AI companies doing where they supposedly are the cause of the ram price spike?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 430 comments

• Is there a way of being able to tell how many tokens a document consists of without a model processing it?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 17 comments

• My 14900k gave out a second time. Is there a way for me to get intel to give me a chip that's not crap?

  Posted by Red_Redditor_Reddit@reddit | buildapc | View on Reddit | 331 comments

• What's the deal with the LLM and overall AI hate?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 9 comments

• Am I doing something wrong with llama.cpp?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 7 comments

• Is there a way that I can have a llm or some kind of vision model identify different types of animals on a low power device like a pi?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 8 comments

• Is Phi-4-mini-reasoning supposed to do this?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 2 comments

• Am I missing something when trying to run a vision model?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 3 comments

• Is it possible to weight certain tokens more or less than others using llama.cpp?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 4 comments

• How are yall getting mistal nemo to work with llama.cpp?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 3 comments

• Does anybody know how a supersonic aircraft actually flies?

  Posted by Red_Redditor_Reddit@reddit | aviation | View on Reddit | 17 comments

• Is there a way to easily get whatever arguments ollama uses for a model to be used directly with llama.cpp?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 3 comments

• Anyone know why I can't run the llama.cpp with the GPU except as root?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 0 comments

• Why did old 486 and pentiums use so little power?

  Posted by Red_Redditor_Reddit@reddit | vintagecomputing | View on Reddit | 41 comments

• Is it just me, or did elon musk rip off the X11 logo?

  Posted by Red_Redditor_Reddit@reddit | linux | View on Reddit | 45 comments

• Is anybody else having problems with glitchy output tokens when using llama 3 8B?

  Posted by Red_Redditor_Reddit@reddit | LocalLLaMA | View on Reddit | 0 comments

• Off grid computing

  Posted by Red_Redditor_Reddit@reddit | linux | View on Reddit | 38 comments

• "Bolt on" error correction.

  Posted by Red_Redditor_Reddit@reddit | linux | View on Reddit | 11 comments