Hacker News new | past | comments | ask | show | jobs | submit
Run benchmarks on it - 24 3D model generations. It's the first google model in a while that does not have creative spark others had. In 3D modeling this means it just does the thing, it doesn't try to make something beautiful/impressive. Which is good I think.

Surprisingly it hallucinates quite a lot - inventing the URLs and variables between different tool calls. Has some of the highest code error per generation I've seen this year.

I am not sure why I would use this model yet.

Can you elaborate on how your benchmarks work? I am hesitating in trying it for game development, mostly animation and blender.