TheaterFire

STOP using small models! just buy 8xH100 and inference your own GPT-4 instance

Posted by Wrong_User_Logged@reddit | LocalLLaMA | View on Reddit | 3 comments

STOP using small models! just buy 8xH100 and inference your own GPT-4 instance

Reply to Post

3 Comments

M34L@reddit

I feel like the main consequence of barring China from high end compute accelerators is ensuring China massively bolsters the research of efficient, smaller LLMs (and ends up developing domestic chip fabrication in the end too).
View on Reddit #72175608

omertacapital@reddit

on the money
View on Reddit #72175609

Independent_Fix4368@reddit

Hip port cuda mi100
View on Reddit #30767062