I freakin' love this demo. It feels magical.
I had the same reaction but then I showed it to my partner. She completely didn't get it, in her words "how can it be thinking of a good answer when it's that quick?"
I tried to explain but I fear were probably going to be adding artificial sleeps to these things to convince the masses it's doing something clever.
to be fair, the model used for Chat Jimmy is not very smart, but the world where it is smart is very interesting.
It’s going to be really crazy when the bottle neck for agents is the speed of the tool calls rather than the speed of inference. Imagine an agent interacting with the terminal near instantly…
I had the chance to try out MiMo v2.5 Pro Ultraspeed (600-1000tok/s) for a couple weeks and it is amazing.
Developing software becomes 95% about intent and requirements. Can’t wait for the next iteration of that.
I asked it some old hardware command line questions I'd recently asked Gemini, it hallucinated parts of the answer.
The characters in the 3-act Shakespearean play had very little depth, many of the names were similar, and they were not very smart, but the simple plot was cohesive.
loading story #49205369
loading story #49204028