Hacker News new | past | comments | ask | show | jobs | submit
Enough! I think it's a reasonably fair test of the models. Let's put it this way, I use the same process to resolve problems outside my peak expertise, and I find it works well.

I think the solution is easy enough that any competent colleague would come up with it. Some variant on it has probably even been published (hence why I'm not chomping at the bit to publish). I think it comes down to the models being extremely spiky, and the problems they're trying to solve being easily verifiable in code.

Have you ever told the AI your answer? I bet if you did it would train on it and know it going forward.
loading story #50253840
loading story #50253691