This is a nerd fever dream. Yeah I’m sure people can’t wait to run local models on their iPhones.
Sometime I wonder if other people on this website lived through the same era of web applications as I did, where people built whole successful businesses on 3rd party APIs, that were destroyed overnight when the terms changed.
Yes, I promise you, there are many, many people who are hesitant to build anything real on the assumption that either Anthropic or OpenAI will continue maintaining their services as they are today in perpetuity.
You don't have to sell it as a local model. Sell it as offline capabilities. Sell it as private background processing while your phone is idle and plugged in. Sell it as un-enshittified LLM once Anthropic and OpenAI inevitably screw everybody.