Especially if you have a lot of critical information in your rooms (a lot of people use it for software development for example), it’s good to keep an offline backup in case something happens to the homeserver. The downloaded messages are in plaintext, but you can always encrypt them separately if that’s a concern (or just put them on an encrypted drive).