Hacker News new | past | comments | ask | show | jobs | submit
embedding-shape | on: Gemma 4 12B: A unified, encoder-free multimodal model
MLX is quite literally macOS-specific technology, for other platforms you want non-MLX.

I was sure "MLX" stood for "Metal-something-something" but can't find any reference to that somehow, anywho, "Metal" is hardware-accelerated graphics on Apple platforms FWIW.

Edit: about the actual release on Ollama, if you're on non-Apple hardware you probably want the NVFP4 variant ("gemma4:12b-nvfp4") which was uploaded 45 minutes ago, especially if you're with a recent nvidia GPU.

Patrick_Devine | parent | next
I realize this is a little confusing; we're working w/ the MLX team to bring MLX to other platforms, but we're not quite there yet. The `gemma4:12b-nvfp4` model is specifically for the MLX engine.

For the GGUF 4bit variant (i.e. non-macs) you'll need `gemma4:12b-it-q4_K_M` which I just pushed. You'll also need to upgrade to version 0.30.4 which we're just about to release (it's in prerelease and we're running through our last regression tests).

embedding-shape | root | parent | next
I gotta say, having both "gemma4:12b-mlx-bf16" and "gemma4:12b-nvfp4" be MLX-specific, and not labeling all of the MLX-specific ones as such, is a bit different than "little confusing" and more "set up to be confusing" :)

> You'll also need to upgrade to version 0.30.4 which we're just about to release

Interesting, wasn't Google coordinating today's release with you? Considering the blog post seems to have gone out way before the release even been cut.

loading story #48390951
spicySpy | root | parent
Would you mind to share the link to `gemma4:12b-it-q4_K_M`?
sambaumann | parent
I still get "this model requires macOS" when trying to pull that one
embedding-shape | root | parent
I don't use Ollama myself anymore, but seems others been having similar issues for quite some time, maybe one of these fit your environment exactly? https://github.com/ollama/ollama/issues?q=is%3Aissue%20state...