M1 Max 64gb here, running Qwen 3.6 35b (unsloth 4bit) and it's plenty usable, and cheap used. Best bang for buck.
heyyy same, checkout kapitsa as the inference engine, gets 145+ tokens/sec
https://github.com/nace-ai/kapitsa
this machine just keeps getting better and better in the inference world. the memory bandwidth is too good, newer macbook pros aren't that much faster in memory bandwidth, many are slower. not enough to upgrade yet as they're mostly horizontal upgrades, the improvements in other areas are adding up like wifi bandwidth and protocol, NVMe speeds, webcam
if they do the M7 correctly: which is just everything their current models do plus way faster memory bandwidth and much greater memory possible 192GB+, then it will be a really great and timely upgrade
loading story #50270895
loading story #50269830