Yeah, I might dive in with llama.cpp at some point, but unless Apple censors the models I can choose I'd just as soon go with Apple's solution.

I also want something that integrates super easily with my iPhone and other devices, and hopefully Apple will make it possible to use my server as an intermediate fallback between my iPhone and their cloud models.