Hacker News new | past | comments | ask | show | jobs | submit
aesthesia | on: Gemma 4 12B: A unified, encoder-free multimodal model
Audio is 1 dimensional so the usual RoPE position encoding should handle it like it does for text tokens. You only need extra position encoding for higher-dimensional stuff like images.