I have one agent and already find it quite intense to outsource code writing and basically just make and document decisions.
I feel like I could be rich working like you, I also feel like it is impossible for me to meet the needs of my clients if I'd work like this (so I can't be rich, it's a paradox). I wouldn't be able to answer their questions (without the active agent on-call, context window fully loaded), I wouldn't be able to explain just where the data model needs changing, or why some role really can't exist they way they envision etc, etc, etc.
I could of course branch the whole project and basically discuss multiple implementations during stakeholder meetings, but then still I'd need to explain the advantages/disadvantage of choosing one system over the other and guide them through it.