Carefully migrating from Windows to Linux reddit / selfhosted ---------------------------------------------------------------------- Thashiznit2003 · 2023-11-13 16:53 I have two servers at my house, both older, used SuperMicro servers, one 2U with 12 bays, and one 1U with 4 bays. I run a Plex server with about 12TB of data on the 12 bay server. That one is running Windows 10 due to previous circumstances destroying the old motherboard, and needing to put the drives into something to get it back online. I would like to migrate that machine to Linux due to Windows/Microsoft doing everything they can to ensure it reaches end of life as soon as possible. However, this is undeniably older hardware. There are 12 different drives in there, most of which have data on them. There is no raid being used. But I do have a backup solution which I’ll explain below. Also, to help it run faster, a few years ago I split up my movies into 4 different folders, on 4 different drives, and tv shows into 2 folders on 2 drives. I’m open to changing this once everything is in place, but not before. If there’s any known issue with splitting up my media library, please let me know. Otherwise, it’ll probably stay this way to make syncing folders easier. I have 3 other backup computers in different geographical locations also running Plex (so my Plex account has 4 separate identical servers available). These have the same data on them, which I sync to these servers anytime there are changes on mine, using an app called Goodsync. However, this is a tedious and manual process (although I did set up scheduled syncs). Those systems are also getting pretty old and will probably start having software/hardware/disk failure before too much longer. These all also run Windows 10, and every drive in all of them is currently using NTFS. These machines were originally set up because of slow internet connections, much of which has been resolved in recent years. However, the added benefit of the backups has also been beneficial when a hard drive dies. These are in standard computer cases, running headless, and connected directly to the routers in those places. I will probably need to upgrade the hard drives in some of these and do a little refreshing of thermal paste/fans, but would like to avoid full replacement. They all have at least 16GB of RAM. My 1U server is recently purchased, and I’ve been setting up proxmox, ubuntu server images, docker, portainer, and other apps that I believe should make my life easier if I can get everything working. I currently have two 1TB SATA SSDs in there. I want to remove two 8TB relatively new unused drives from the 2U to put in the 1U. I am a former desktop support IT guy, have some prior experience with Linux, and would consider myself a proficient googler, and medium- knowledge user when it comes to Ubuntu. There are definitely some things I don’t know, and haven’t been able to locate any answers to, which is why I’m posting here. I’m also a few years removed from being an IT guy, so have forgotten some things. Pointing me in the right direction is usually sufficient. I’m thinking I’m not wording things correctly when I’ve been searching. I am trying to do this changeover incrementally, so as not to bring down the Plex server for too long. So, the Windows 10 2U server will stay running until I get everything working on the new 1U server, and I’ll need to figure out how to swap Plex to the 1U temporarily while I set back up the 2U server on Linux. Issues/questions: 1. I am currently having problems with docker really not wanting to see, read, or write my smb shared movies/tv show folders within the containers. I’ve mounted them on the host Ubuntu image and set up volumes in docker compose, but keep running into permissions (and docker AppArmor) issues with things like Radarr/Sonarr viewing my library. Does anyone have experience with the -arr apps when the password protected library folders are residing on a network share, and accessing exclusively with smb/cifs through the docker? I’m thinking there’s an easier way of doing this that I’m not aware of. 2. What is the best method to transfer the media data to the two 8TB drives that I will put in the 1U server? Since I need to “convert” all the data to be on a Linux filesystem, I’m pretty sure the best method is a network copy from Windows to Linux, which I am fine with doing. But, what should I do to make sure the copy succeeds and sets me up to use this data properly? Ive already shared the folders in Windows and they’re accessible. 3. Once everything is copied to and running on the 1U, I can start working with the 2U server, and copy the data again to the 2U’s drives after I get Linux set up on it. What software should be used here for creating basically a JBOD out of the 2U using several different size drives? What should be done to ensure everything is accessible from one server to the other and each’s docker containers? 4. I need to set up some sort of automated replication and sync service for the data to the machines in the other locations. What should be used for syncing data from Ubuntu to Windows (until I have a chance to upgrade those other machines), and later Ubuntu to whatever is used in the future over some kind of peer to peer connection over the internet? 5. What should I set up on the machines in the other locations? They don’t need the full work up my 1U is getting, but I do need to sync data and run Plex on them. I’d also like to have my 1U machine at my home be able to see the vital statistics of these other machines and properly monitor them. ---------------------------------------------------------------------- reklis · 2023-11-13 17:49 You are probably running into permissions issues because of the user id and group id. ​ Example fstab entry: //192.168.1.33/media /mnt/media cifs nofail,iocharset=utf8,nop erm,vers=2.0,uid=1000,gid=1000,credentials=/etc/credentials,file_mode= 0775,dir_mode=0775 0 0 Example docker-compose: --- version: "2.1" services: radarr: image: lscr.io/linuxserver/radarr:latest container_name: radarr environment: - PUID=1000 - PGID=1000 - TZ=Etc/UTC volumes: - /path/to/data:/config - /path/to/movies:/movies #optional - /path/to/downloadclient-downloads:/downloads #optional ports: - 7878:7878 restart: unless-stopped where uid and gid match your normal user output from the id command ---------------------------------------------------------------------- Thashiznit2003 · 2023-11-15 01:17 Except for: nofail,iocharset=utf8,noperm,vers=2.0, and file_mode=0775,dir_mode=0775 0 0 That’s exactly what I did. Would those options make much difference? ---------------------------------------------------------------------- Thashiznit2003 · 2023-11-15 01:18 Except for: nofail,iocharset=utf8,noperm,vers=2.0, and file_mode=0775,dir_mode=0775 0 0 That’s exactly what I did. Would those options make much difference? ---------------------------------------------------------------------- reklis · 2023-11-15 03:51 File mode and dir mode would potentially make a big difference