I just saw something amazing

my bet is on matmul acceleration in photonics as a coprocessor once we can copackage solid state lasers (galium arsendite) - photons dont get hot unlike electrons .. - and we can push a systolic array as fixed configuration in waveguides - additonaly the fab process can be done pretty much anywhere .. as that gear from the late 80's is good enough for those feature sizes / side effect is that we can multi spectra emit and push the bandwidth that way - i mean .. its robust already .. as thats how the internet works in the end of the day - and we process pb's of data every that way .. just needs to be shrinked and copackaged .. the problem with custom fixed hardware is that they are bulky and you need many of them - masks are expensive - if you need to spend 20-50mil on a 1 unit of scale with lowest redundancy for something that lasts you 3 months - good luck .. and its not infinite batching either - groq has similar issues with there inference systems - if there are many users -> they are cooked - thats why its overall hardly faster then gpu's its always a tradeoff in flexibility .. if you spend 400k on a b200 box / 4.2 mil on a nvl72 rack and remain flexible .. or go for speed which has 0 chance of useage over 3-5 years as imageing you have to use llama 1 for everything today