Hacker News new | past | comments | ask | show | jobs | submit
They did test for correct interpretation, so what point are you making?
His point is that he has read Shakespeare but not the linked article.
loading story #50359838
These are famous games tested here though, and I tried to feed one problem to DeepSeek 4.1 Flash 1017 and it comes back at 66% confidence it is a Pac-Man (incorrect). That smells to me the problem setup heavily hint towards these 2D games. Might be resolution related to be honest.
loading story #50361011
From what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something.
loading story #50358248