I'm currently on Raven as a sort of "meta harness". The main chat is with the orchestrator, which delegates all work to other harnesses. I just use different seat-based plans. Mostly the latest Sol with my corp chatgpt account.
I get a lot of value from having an LLM to talk to LLMs for me. It can automatically set up adversarial reviews from other ecosystems, or just prompt the implementation LLM to adhere to certain standards. My goal is to have fewer touch points when implementing. I want to speech to text a paragraph or two giving "taste" to the process; everything else is just toil.
What is your experience with Raven or such meta-harnesses, does it consistently outperform vanilla?
I get the same "one-shots" from the vanilla codex as codex under raven. It took some work to get the orchestrator to send good refinement prompts, and it still doesn't have good taste. I need to bring that with my own review of the code. If you notice you send a lot of repetitive refinement prompts it's worth it.
[dead]