You're right not to trust cloud providers with your life's history. They are not trustworthy.

Thunderbird is a great way to back up emails. You can tell it to store everything locally. It stores everything in handy sqlite tables under the covers.