Yeah, I'd assume it's possible to extract all languages as steering vectors from a model and then substract the ones you don't need from its weights.

However, that would just change the weights values and not their dimensions.