Hacker News new | past | comments | ask | show | jobs | submit
It seemed to have stalled in investment before i think. Performance especially for CPU only models ( there are some use cases for this ) seemed to have lagged a lot, behind what properly hand optimized code could do.

The gpu work was mostly handed of e.g to TensorRT and that also seems since the push for more general LLM models have not really improved.