Hey, I run local inference on a few RTX 6000s and will say it's pure delusion to think you get "quantized frontier tier inference" on a modern $1600 video card.
I get that you want this to be true. It is not true.
It is not frontier tier, it is not anywhere close, and if you think this you are out of touch with the frontier
Here [1] are some various benchmarks for a RTX 4090 on models like Qwen 3.8, where it usually hits around 43 tokens/s. You can find similar vids on YouTube showing it live for comparison, 'proof' if you doubt, etc. And yes, it is frontier tier.
Dude, why do you think I care about benchmarks on a 4090 when I know for a fact my 6000 Blackwells are insufficient?