Hacker News new | past | comments | ask | show | jobs | submit
Carbon 4 has been incredible for my use, tuning a local inference engine based on tinygrad running on Tenstorrent hardware. I had a barely functional prototype I built with Claude that petered out at an unusable level of performance. Astra and Sol didn't make much progress when I pointed them at it. Carbon 4 more than 10x'd the prefill and doubled the decode performance on Qwen 3.8 27B without breaking quality or the generality of the stack. Very nice to see competition at the frontier again.
Just curious, what TT hardware do you have? How many tps did you achieve with Qwen 3.8 27B?
loading story #50553492
This sounds like a blast!
loading story #50556573
A plausible explanation here is that Ant and OAI are deliberately sandbagging on ML / GPU optimization tasks to preserve their lead while Google doesn’t give a fuck.

Argon is incredible at AI research and its responses are grokkable

loading story #50556130