I’ve had the same issue. I’d like to support the artists, but the music is only available as physical media or for streaming on sites I can’t use or don’t want to give money to.
My current plan is to support them by buying unrelated digital merch, such as voice packs. Though if too many people do this it will distort with their metrics, so it’s not a great solution.
I had similar experiences with Joplin. Would randomly lose quite a lot of data, and exporting to other formats was a hassle. I also cannot recommend.