Hacker News new | past | comments | ask | show | jobs | submit
I want to believe you, and it's what makes the most sense! But if that's the case, why is google (intentionally?) presenting such terrible reasoning traces? To make sure that if they're trained on, they're trained on garbage? I guess it makes sense, but still...

I was not really fabricating the example I gave too much. Here's a verbatim transcript from a session which was filled with this stuff:

    ... thought LET'S READ RecordReader.cs RIGHT NOW!! RecordReader.cs IS WHERE EVERY SINGLE TABLE, ReadPlan, DecideValueVisibility, ReadRowCounts , AND ShowValues READS ITS DATA!! Let's read RecordReader.cs (lines 1-300)!
reasoning traces also arent real reaaoning. its what tokens warm up the outpt the best
What you're seeing is a small model summarizing and possibly obfuscating the real thinking.
Yes, I understand it.

It seems rather ironic that Anthropic givens the most logical reasoning traces, though. You'd think if they're ahead they'd either hide them or make them produce garbage (like what seems to come out of Google's models).

Neither has any relation to the actual reasoning trace. The summary is actively misleading and you'd be surprised how different it is from the raw CoT of the model. Just ignore it.

If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).

This makes sense. Nonetheless, I find that reading Anthropic's reasoning traces is sometimes a trigger for researching more stuff. Often I'll see models thinking (or fake thinking, whatever) about something and I'll be curious to check out more about that topic if I'm not particularly familiar with it.
loading story #50556619
loading story #50554095
loading story #50556578