I suspect it's actually impossible to get reasonably good at something without some amount of passion for it, to some degree or another. Most musicians are in it for the thrill of learning something that most people find hard to do, or because they love music, or because they want to be part of a community that values music. Occasionally because they think they can make money at it.
I play an instrument or two, but only for fun. I love music, but I'm at a point in my life where I will never be good enough to be in a band. I have enough other hobbies anyway. I take a random 15 minutes out of my day to play a few songs, maybe practice a new song I'm learning, watch a short Youtube video about it here and there, and that's enough for me.
Loving musing doesn't mean you can play it.