It seems worse than 3.6, but a bit smaller.
UPD. was wrong on smaller, it's actually much larger
I'll back up your smaller claim, but be specific that it's UD-Q4_K_XL size:
- muse glimmer: 15.9GB
- qwen 3.6 27B: 17.6GB
My video card is so close to its limit that these GB thresholds are mattering too much for me :D
How is 30B smaller than 27B?
It uses fractal compression
They say it is trained with quantization awareness, so it should only be 15GB or so. Qwen was only trained in FP8 with QAT.
UPD, NVM, got misled by comments here. It is actually almost 60 GB so much larger
Quantization awareness doesn’t change the size of the weights, just means it won’t degrade when quantized. QAT = quantization aware training. They will both be very similar in size at the same quant.
You're mixing up sizes of different quants. The 60GB is unquantized, and Qwen's unquantized size is around 54GB. Their sizes as like quantization levels are similar.
loading story #49244424