The quality drop off when vibe coding something novel is pretty sharp. LLMs lean heavily on the existence of relevant training material.
That occurred to me when the author of the article was impressed with how well GPT-6 could reproduce zstd. Like hiw many of the trillions of parameters are just pieces of zstd.