What is this witchcraft? reddit / selfhosted ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-16 20:54 Almost 10 years ago I purchased a Synology NAS for local storage and backups. I was really happy with the ease of use and their support is top notch. I got it set up and didn’t think much about it. Fast forward and a deal on a used server comes around and all the sudden I have a lot to learn. Proxmox, TrueNas, Nginx Proxy Manager… a whole new world I had somehow never even thought about. The concept of virtual machines blew my mind. Spin up a machine, mess it up, tear it down, repeat. Kids wanted to host a Minecraft server. No problem, pterodactyl. But wait, pterodactyl wants to be installed in a machine that doesn’t have any other software installed. No problem, I got one of those! This is magic and I’m loving it. I mostly lurk around here but thanks to everyone who posts because this place is a great source of knowledge and sarcasm and I appreciate both! ---------------------------------------------------------------------- MaliciousMango1 · 2023-10-16 21:04 Welcome homie! ---------------------------------------------------------------------- EndlessHiway · 2023-10-16 21:04 You're welcome. ---------------------------------------------------------------------- MacGyver4711 · 2023-10-16 22:05 The base of this - you are human and humans want to learn. Welcome to the club..!! Feel free to share anything you come about that might have an interest to others :-) Or even better - get a Github account and share the real deal with us ---------------------------------------------------------------------- davidedpg10 · 2023-10-16 22:55 Welcome! I'm glad you've found this. If you haven't given containers a try yet, that will be the next thing that will blow your mind. But all in due time ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-16 23:26 You figured me out, not a bot! I need to utilize GitHub for deployment and config but I’m not there yet. Thanks for the reminder! ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-16 23:35 Been working into docker. Running nginx proxy manager, paperless-ngx, WireGuard, adguard, bitwarden, Jellyfin, and a couple others right now. Some run in a container on the NAS, a couple on a pi, and the rest on the server. Much more to learn… ---------------------------------------------------------------------- Oh-This-Guy-Pucks · 2023-10-17 00:36 Let’s say you do like me and configure multiple LXCs and VMs in Proxmox to keep your services segregated, and you want to run Docker services on all of them… Portainer (plus Portainer Agent on all the different hosts) lets you manage deployment across everything from one central UI. That plus Watchtower on all your hosts to keep all your containers fresh and up to date, and Pushover to send you push notifications as updates are happening… it’s pure magic. ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 00:40 I need to be better about my docker deployment. Services running on 3 devices. Some docker, some docker-compose, and some were setup in portainer. It’s a bit of a mess tbh. Portainer agent sounds promising. I’ll check it out. Thanks! ---------------------------------------------------------------------- Turbulent-Stick-1157 · 2023-10-17 01:56 Portrainer FTW! ---------------------------------------------------------------------- thedthatsme · 2023-10-17 04:30 Can you elaborate on your user server hardware? I converted my 2012 desktop with TrueNAS and I've been but by the bug. I hoped to run a NixOS VM and my processor temps went instantly through the roof. ---------------------------------------------------------------------- sl_hr · 2023-10-17 07:57 Just a side question, what are pros of having docker around on various hosts compared with having one dedicated docker host? ---------------------------------------------------------------------- sl_hr · 2023-10-17 08:30 Throw in Ansible in the mix. Or even Terraform as well. ---------------------------------------------------------------------- isleepbad · 2023-10-17 09:44 Terraform user here. Man it makes life so easy. If you add "cheating" with local exec it'll make life a breeze. ---------------------------------------------------------------------- Oh-This-Guy-Pucks · 2023-10-17 09:52 In hindsight maybe not a ton, but my thinking going into it was that if one container were to get compromised, the attacker would find less other stuff on each host. So the most logical way I could see to segregate my services was by purpose (media, productivity, bitcoin etc) ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 10:07 Ansible I’ve heard of. Terraform I’ve not. Thanks for the heads up, I’ll look into it! ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 10:13 As I said, I’m kind of a mess. I added containers while adding devices so segregating wasn’t necessarily my intention. That said, I will most likely keep DNS and DHCP on a single dedicated device. That, for some reason, makes sense to me. The rest I may move together except for the vpn services. I will run the 2 on different devices in case one service gets blocked by the external network I’m trying to connect from. I already ran into this once where WireGuard got blocked but OpenVPN did not. ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 10:29 Sure! I was offered an 9 year old Intel 2U server. High spec back then. Dual Xeon with 256G ram and room to expand. 16 2.5” drives on the front. I bought a pile of 20 1.2T HHD because it was the only thing that was reasonably priced. But I also found a pair of 1.8T SSDs so these are in the front and are storage for most of the VMs. TrueNas scale manages the remaining 14 drives as storage. Proxmox runs on a pair of internal 300G SSDs. It’s way more machine than I would have looked for but… ---------------------------------------------------------------------- hexathos · 2023-10-17 10:47 I've sentry, drone, gitea, grafana for loggingmetrics, on one lxc... so i can migrate and backup my dev stuff whenever i want, without thinking about it... without forgetting something... and without blocking other stuff ---------------------------------------------------------------------- verticalfuzz · 2023-10-17 11:21 Wait... docker on *multiple* LXCs but portainer on *just one* of them? Why/how/what? ---------------------------------------------------------------------- Oh-This-Guy-Pucks · 2023-10-17 11:23 Yeah, you have one main deployment of Portainer, then you can install Portainer Agent on the rest and connect to them from the main Portainer instance. Only drawback is that any services you deployed prior to setting up Portainer Agent will need to be redeployed using the central Portainer instance, but that’s one-time pain. ---------------------------------------------------------------------- Brilliant_Sound_5565 · 2023-10-17 11:46 Enjoy. I would say with a home lab, try and plan things, what is it you want to host, what is the best hosting platform, vm, lxc, physical install etc etc. I say this because it should help stop the 'splatter' effect somewhat where you end up with all sorts of systems and installs all over the place. So I treat mine a bit like a work environment . Oh,.and don't forget backups ! ---------------------------------------------------------------------- Nagashitw · 2023-10-17 13:55 Wait until you learn about docker and kubernetes. You will not touch virtual machines again (for the most part) 😂 ---------------------------------------------------------------------- wickedwarlock84 · 2023-10-17 15:20 Go look at yacht.sh, I'm a dev there and you love the eaze of use. ---------------------------------------------------------------------- oddllama25 · 2023-10-17 15:23 I've spent the last two months learning all of the same stuff by the same method. Often I try to take in too much in one go and end up with nothing retained. But just like in pfsense, those buttons that break everything are etched into my brain. ---------------------------------------------------------------------- wickedwarlock84 · 2023-10-17 15:29 They don't have to be on the same network as long as they can communicate openly on port 9001. I open ports on my firewall and AWS for my cloud systems and home systems to both be controlled under one panel. But I restrict the source and destination IP address as well. This can also be restricted or more secure under a vpn ---------------------------------------------------------------------- TheGreaterSage · 2023-10-17 16:09 A little late but if you are still hosting game servers I really recommend something a other than pterodactyl. When I was setting them up I found it the most obtuse to use and configure. Something simple to setup is [PufferPanel](https://www.pufferpanel.com/) and what I ended up settling on is [CubeCoders AMP](https://cubecoders.com/AMP). Though AMP does cost money, it's also the best one I have used, easy to setup and configure, runs great and was a one time purchase. PufferPanel was great for Minecrafter servers though. ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 16:17 I do have cubecoders amp running as well. And, I agree, setup was easy and I have a bungee cord server running on there now. I don’t mind paying a reasonable one time price for well supported software. The only reason I am also trying pterodactyl is the integration with databases directly in the panel. I wanted to try a few addons for the Minecraft server and they require regis and sql. Still working on getting it all setup but I also read that database support is in the pipeline for Amp so I’m looking forward to that. ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-17 16:54 I hear ya. Between work and family it usually 9:00p before I start fooling around with stuff and by morning I have no idea what I did. 😅 ---------------------------------------------------------------------- thedthatsme · 2023-10-18 00:59 Very nice. I'm jealous. So you don't run TrueNAS inside Proxmox? I see that seems to be super popular method, but I decided I really wanted a good storage server first and foremost. If I had some server hardware I'd probably run everything inside Promox. ---------------------------------------------------------------------- Royal_Olive9948 · 2023-10-18 01:45 Sorry, I was probably rambling an unclear. TrueNas is running under proxmox and handles the raid for the 2.5” drives on the front. Lots of drives but because of the form factor I couldn’t find reasonably priced high capacity drives. Total storage ended up around 11T. ---------------------------------------------------------------------- tymorton · 2023-10-18 02:46 >yacht.sh Whats different compared to [cosmos.io](https://cosmos.io) , runtipi, casaOS, and others? ---------------------------------------------------------------------- wickedwarlock84 · 2023-10-18 02:48 Yacht is a docker manager like portainer is, not a hosting platform. It just manages your containers same as portainer. ---------------------------------------------------------------------- brando56894 · 2023-10-18 06:17 > Much more to learn… I've been at this for over a decade and there's always more to learn! If you haven't checked out docker-compose yet, that's your next step. It allows you to script container setups :) I have 5 compose files based on categories (pirating, media servers, admin, etc...) and a shell script to launch them if I want to install them all, otherwise I just call the specific compose file. I can have all my apps up and running on a new server in about 10 minutes. Docker is awesome when it works well. ---------------------------------------------------------------------- anonimeni · 2023-10-18 15:27 How do you use terraform in a home environment? It's been a while since I last touched it. ---------------------------------------------------------------------- isleepbad · 2023-10-18 19:02 You just need - the [terraform executable](https://developer.hashicorp.com/terraform/downloads) and - The docker [terraform provider] (https://registry.terraform.io/providers/kreuzwerker/docker/latest/doc s) After that you just convert your docker run/docker compose into terraform resources. Throw everything into a main.tf, or split the files up like (main.tf, variables.tf, provider.tf...and so on) Then do the command trifecta * terraform init * terraform plan * terraform apply