It really is the determinism aspect for me. Okay, it’s programming if you sample at temperature 0 with a fixed seed on a fully deterministic inference stack and you have made your prompts the artifact that you iterate on (repo full of natural language that “builds” into the running software it describes with the use of the LLM sampling at temperature 0)
Why is everyone so hang on determinism? Monte Carlo methods are nondeterministic but still programming. We use random generators in many programs.