One might argue that data breaches been there way before AI, the difference with these AI generated apps is:

- They are an easy target, they don’t need any sophisticated hacking knowledge (article mentions inspecting network calls in browsers).

- There tons of those, and more created everyday. For the average user, they don’t know what they are using, or how risky it can be.

Nothing to see here and working as intended.

Imagine frontier abliterated models running at 2,400 TPS finding all these issues rapidly on web apps like this.

You are not ready security-wise when these models get faster. ("Formal verification" won't save you either)