We're working on provable inference at Attestable (https://attestable.com/) - our solution is one of the comparisons provided.

We've published initial performance metrics in August of 87 t/s on Muse Glimmer 30B (a dense model) - orders of magnitude faster than existing OS projects. Antropic's FlashProve supports only a fully integer model with a small context length (significantly hurting evals).

There is significant progress since then, and we'll publish more results soon.