In the open weights scene, it is always chasing closely behind. Many leading edge big open models are trained in-part with distillation of large commercial hosted models.

It already has. If you have a gaming GPU you can run AI locally.