If you actually want your "AI" to interact with anything digital, are these voice-to-voice models going to...use speech to text? How does this model interact with anything that isn't an audio channel?
They can perform tool calls through text even though they're speech models, OpenAI showed this off with their latest ones I believe.