I've been in the habit of checking eBay for AMD Instinct prices for a few years now, and noticed just today that MI210 prices seem to be dropping pretty quickly (though still priced out of my budget!) and there is a used MI300X for sale there for the first time, for only $35K /s

I watch MI60 and MI100 prices too, but MI210 is the most interesting to me for a few reasons:

• It's the last Instinct model to use a PCIe interface (later models use OAM or SH5), which I could conceivably use in servers I actually have,

• It's the last Instinct model that runs at an even halfway-sane power draw (300W),

• Fabrication processes don't improve significantly in later models until the MI350.

In my own mind, my MI60 is mostly for learning how to make these Instinct GPUs work and not burst into flame, and it has indeed been a learning experience. When I invest "seriously" in LLM hardware, it will probably be eBay MI210s, but not until they have come down in price quite a bit more, and not until I have well-functioning training/fine-tuning software based on llama.cpp which works on the MI60. None of that exists yet, though it's progressing.

Most people are probably more interested in Nvidia datacenter GPUs. I'm not in the habit of checking for that, but do see now that eBay has 40GB A100 for about $2500, and 80GB A100 for about $8800 (US dollars).

Am I the only one, or are other people waiting with bated breath for second-hand datacenter GPUs to become affordable too?