I’m thinking about making some changes to my home server to make it a little more robust and let me do some cool new things with it (like actually trust it for backing up data to with NextCloud, replicating VMs or data across sites, etc). I’m just looking for any advice people might have for this process to migrate hypervisors.
What I currently have:
- Windows 10 Pro OS with Hyper-V
- Running some applications on the host OS (Plex/PRTG/Sonarr/Radarr)
- Running a few VMs for things I set up after I realized “I should be doing these in VMs…”
- 4 HDDs for data, each just mounted individually. 2 for TV, 1 for Movies, 1 for Backups
What I’d like to have:
- Better OS for running the hypervisor (Proxmox is what I’m reading may be best, but I’m open to suggestions)
- Nothing running on the host OS other than a hypervisor
- All my services running virtualized, be that via Docker in a LXC or a guest OS.
- My Drives all in a RAID 5. Planning to add more drives at some point as well.
My thoughts on the process are that the “easiest” way may be:
- Just throw a new OS drive in to install Proxmox on
- Export my VMs from Hyper-V and import them into Proxmox
- Set up the services I had running on the host OS previously in their own VMs/containers
- Make a new RAID either: a. with new disks or b. by combining data from my existing disks so I can get a free few disks to start the RAID with, then moving data into the RAID and clearing out more disks to then add to the RAID, rinse and repeat until done (that’s a lot of data moving I’d like to avoid…)
I wasn’t sure if it would be a smarter idea to do something more like this though (assuming this is all possible, I’m not even sure that it all is). If this is possible, it might reduce my downtime and make it so I can tackle this in bits at a time instead of having an outage the entire time and feeling like I need to rush to get it all done:
- New OS drive for Proxmox
- Use Proxmox to boot my Windows 10 drive (this I’m not sure about) so that everything continues as it’s currently set up.
- Slowly migrate my services out of the Windows 10-hosted VMs and host-installed services
- I probably still have to deal with the RAID the way I mentioned above
Is there any other method I’m just totally not thinking of? Any tips/tricks for migrating those Hyper-V VMs? That part seems straightforward enough, but looking for any gotchas.
The reason I haven’t done anything yet is because I only have so much time in the day, and I’m not trying to dedicate an entire weekend to this migration all at once. If I could split up the tasks it’d make it easier to do, obviously there are some parts that would be time-consuming.
Thanks in advance!
Don’t run docker directly on your host. It likes to fuck with your IP tables in ways that make VM networking break. Create a single VM to be your docker host and then put all the containers on there (KVM - which is what Proxmox is under the hood - offers near-native CPU and memory performance anyway).
When building your VM environments I’d suggest going with XFS for your file system. At my work we recently switched over our containerised apps from EXT4 to XFS and got a 4-6 times improvement in IOPs as a result.
I think exactly the opposite, in 5 years i never had any problem with IP tables (although i assign a manually created network to each docker).
One of the biggest advantage of docker is that it can access unlimited memory and storage from host, without reserve a specific amount of both. If now it used 200mb, it doesn’t waste the 8gb you would assign to a VM. And if tomorrow it needs 10gb, it can access the extra unused RAM.
Run it in an LXC for a middle ground? Limitable but also can be unlimited resource use
Maybe better
Docker will block networking to KVM VM’s if they are configured with a network bridge, aka giving the VM’s their own LAN IP address. I had so much trouble I switched to podman. Also, you’ve been working with containers for 5 years and call them dockers? Not the strongest ethos based claim.
Never happened to me
I’m not saying it’s impossible but it’s not a common issue that happens by default
This whole post is in the context of virtual machines, and the claim you felt exactly opposite about was that docker will mess up VM networking. If you don’t use a network bridge with KVM that’s fair but I’m not sure why you would disagree with advice to a problematic situation only because it does not apply to you.
i use a network bridge with KVM and i have containers with no issues… It worked fine at first install and I don’t think i am the only one in the world.
My apologies, I see.
Sorry, it doesn’t work for you, so it can’t work for anyone else in the world
Maybe mention that sooner next time instead of just disagreeing
I would love to see proxmox add podman to the host OS and webui in the future.
They are pretty opinionated about LXC and opposed strongly to direct docker intergration, so I wouldn’t expect it.