The OSI actually published an "open-source" definition for model weights, which requires the training code and training data composition to be published. The exact training corpus can remain private though.

https://opensource.org/ai/open-source-ai-definition