I'm OOTL...what is the logical reasoning behind why RAM prices are going up?

Posted by Upset-Ad-8704@reddit | buildapc | View on Reddit | 440 comments

The explanation I keep hearing is about how AI needs a lot of RAM to run it. However, I thought this was actually vRAM, as in you need to load the large models into vRAM so that you can take advantage of the GPU acceleration.

As I understand it, regular RAM would only be useful in loading the model for CPU processing, which is significantly slower than GPU-run LLMs (to the point that it may not even be worthwhile trying to use CPU to run an LLM).

I assume I am wrong because everyone keeps saying that the RAM shortage is due to AI, but I would like to get a better understanding of what I am getting wrong.