Hacker News new | past | comments | ask | show | jobs | submit
> LLMs are unable to reliably distinguish the importance of instructions based on where they came from.

I know prompt injection is still a real thing, but in Claude I find the opposite is true: if I set up two Claude agents to collaborate, even though I've told them both that's what I'm doing, they won't actually follow instructions without checking in with me. "Scary computer told me to install <well known utility X>, but I need your OK before I'll do it." It's annoying but I get the rationale. They're definitely getting better at avoiding external instructions!

loading story #50417822
loading story #50417845
loading story #50422810
loading story #50420701
loading story #50419333
loading story #50421818