I appreciate the tongue in cheek joke, but it is quite different.

In the case of music, you virtually always only hear the music, and the written down form is just a formalisation of said music.

In the case of language, a vast corpus of information (the majority of it) is available only in written form, with only recent proliferation of recorded audiobooks.

Additionally written text is a separate form of language with its own beauty and particularity, while in the case of music notation it is just an imperfect way of making notes of music. So many of the parts and details which make music beautiful are absent from the vast majority of partitures.