Agreed, deploying AI gateways has become extremely common in enterprise settings. A lot of admins think they are going to use it for guardrails, but I think the real value is in centralized cost tracking and ability to (relatively) seamlessly aggregate providers.
AI can program a cost tracker tool pretty easily.