Hacker News new | past | comments | ask | show | jobs | submit
Not making any claims about a specific model's capabilities, but all these "can interpret model weights" posts brings to mind the line in Shakespeare's Henry IV

GLENDOWE: I can call spirits from the vasty deep.

HOTSPUR: Why, so can I, or so can any man, but will they come when you do call for them?

I can interpret weights too, but will that interpretation be correct?

They did test for correct interpretation, so what point are you making?
loading story #50358519
loading story #50358631
loading story #50357808
loading story #50360621
> I can interpret weights too, but will that interpretation be correct?

Chances are much higher than a model can figure out what the patterns are, decipher them, and retain that knowledge in a meaningful way it can reason about. Me and you might take years or months to do all of that on our own, with a "map" of the weight we might be able to discuss it, but not as effortlessly as an LLM.

Honestly, I had told a few different colleagues that reading a model is probably not that exclusive to frontier models. It's probably yet another reason OpenAI / Anthropic don't release any big open weight models, but thankfully Google and Microsoft release reasonably sized models. Imagine a new GPT open weight release, it would get dissected drastically.

loading story #50360617
loading story #50360574
loading story #50357677
loading story #50356508
And this reminds me of the king in the little prince, who had the power to order the sun to rise or go down. But only once a day at a certain time.
loading story #50357086
loading story #50357358
loading story #50358612
loading story #50357850
loading story #50357162