Looking for a platform/OS to host my services reddit / selfhosted ---------------------------------------------------------------------- Anaerin · 2023-09-28 17:55 I've got a few servers of various kinds, self-built and old rack servers, that I use for my homelab, but things are kind of a mess. * My router is an old Dell Optiplex 755: C2D E6750 CPU, 4GB RAM and a Realtek GBit NIC for the extra LAN port - It's ancient but it works, and it's running pfSense. It's handling ad blocking (pfBlockerNG), certificates (ACME), Split DNS (Unbound) and most importantly reverse proxying (HAProxy) for services both inside my network, and publicly accessible. * My fileserver is an IBM X3650 M3 with a pair of Xeon X5677's and 72GB RAM. Oh, and 10x5TB drives (2x5-way RAIDZ, yes I know SMR drives are bad, find me SAS/SATA drives with more than 5TB storage in a 2.5" form factor that don't cost a pair of kidneys each) for storage and 6x1TB drives for jails/container storage. That's running TrueNAS Core 13, and hosting VaultWarden, NextCloud, Plex and qBT. I intend to move Plex off, as soon as I can get some supported hardware for transcoding. Those two are probably going to stay the same, though I'm trying to migrate the few services I'm hosting on the TrueNAS box away (albeit temporarily) with an eye to switching it to SCALE instead, for better support with Linux/Kubenetes. The other machines are: * Dell R200 (Xeon X3360, 2GB RAM (DDR2)) running Alpine v3.16 as bare bones as it can get, with Docker and Portainer Agent on top. * Whitebox (AMD AthlonFX 6100T, 24GB RAM) Running Ubuntu 22.04.3 LTS and Docker/Portainer. What I'd like is a way to run containerized services on both those machines, and any others I pick up, with centralized file storage (on the NAS) so they can be migrated/failed over if I have a hardware issue or downtime, centralized management, and HA with a shared virtual IP or IPs. My options appear to be: * Proxmox VE * Complete solution * Well-supported * Easy to get * Supports clustering for VMs * Uses LXC for containers, not Docker, so all my existing containers and services would have to be scrapped, migrated or rebuilt. * Docker Swarm * Requires an OS to be installed under it * Not sure about fail-over * Still needs something like Portainer to control it easily from a central location * No longer supported? * Rancher * No RancherOS anymore, so you need an OS underneath * Seems easy to install with their docker-based installer * Based on Kubenetes, so Docker support. * Some centralized management * Seems to need a \*bunch\* of nodes before it's usable * Kubenetes/K8s/Minikube/K3s * Building from scratch, on an OS, needing a bunch of stuff and research in place already * Seems to assume you're working at/with a VPS like AWS or Azure and already have access to a bunch of services (S3 storage, Ingress management, etc) * Lots to get wrong, plenty of guns for feet. Is there anything I've missed? Is there an easier way? ---------------------------------------------------------------------- epsiblivion · 2023-09-28 19:53 you can run docker on proxmox either in vm's or lxc. vm's are more secure but lxc is acceptable if you understand the risks. ---------------------------------------------------------------------- EverytingDead666 · 2023-09-28 20:18 Debian with Docker compose ---------------------------------------------------------------------- Anaerin · 2023-09-28 21:00 It seems to me that deploying a Hypervisor to run a VM that contains a Hypervisor to run containers/VMs is a little wasteful. Why would I not just run Docker/Kubenetes on raw hardware, and skip that overhead? ---------------------------------------------------------------------- epsiblivion · 2023-09-28 21:08 Because proxmox has builtin snapshot and backup features. Easy to roll back or restore when needed. ---------------------------------------------------------------------- stupv · 2023-09-29 01:23 Just run docker under proxmox if you already have those workloads in ready to go containers. Most homelabbers running proxmox are also running docker in a VM or LXC ---------------------------------------------------------------------- stupv · 2023-09-29 01:24 Not everything is going to fit into a docker container, and for that you have Linux containers. If you wanted to go full worst-practise, you could run docker directly on the host and avoid the nested virtualisation ---------------------------------------------------------------------- mrchem1911 · 2023-09-29 11:44 Maybe Unraid ? ---------------------------------------------------------------------- lmaomitchs · 2023-09-29 13:39 You Can find it here hostadvice24.com