I have embarked on this quest for self hosting. reddit / selfhosted ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 03:50 A Synology NAS and an Intel NUC are coming in the mail. I also have an RPi 4B. Before I do anything, what would be the most elegant way to split up duties between all of these devices? ---------------------------------------------------------------------- ithilelda · 2023-09-28 05:10 there is no universal solution. I would recommend looking for the word "comfortable" rather than "elegant". It's your stuff and you should just do it your way. At the very least, we have no idea about what you're gonna host so there can't be anything to suggest lol. the only area where you need advice from other people is security. Know what you're doing before opening a port/exposing something publicly. otherwise, there really isn't much to say. ---------------------------------------------------------------------- Over-Advice6046 · 2023-09-28 05:12 If i were you, i will use Intel NUC for main server using proxmox and divide it using vm hosting a ubuntu server and container (or docker). And then use the synology NAS for backup or media storage, I have no idea what to use on RPi 4B :). Cheers ---------------------------------------------------------------------- koolboy145 · 2023-09-28 05:58 I have used this setup previously. I agree with NUC for proxmox or a server based role to support any apps you might want to host. Use the NAS for storage. You could use your raspberry pi for pi hole ---------------------------------------------------------------------- NikStalwart · 2023-09-28 07:42 Docker/k8s/k3s swarm? ---------------------------------------------------------------------- CountZilch · 2023-09-28 08:54 PiHole ---------------------------------------------------------------------- Over-Advice6046 · 2023-09-28 09:53 Ah yes, PiHole. I forgot that one :) ---------------------------------------------------------------------- Xiakit · 2023-09-28 11:04 I have basically the same setup. Split it like this, all things using a lot of CPU on the NUC using docker (docker compose). All things needing a lot of space are on the NAS, for example Plex runs on the NUC but gets the files from the NAS (mounted via NFS). Other things I use on the NAS: - Photostation - Backups - Storage ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 15:17 That’s what I got it doing now. I guess I’ll just make it my redundancy device for things I don’t want taken offline. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 15:24 That’s like next level stuff, I think. Currently I don’t know what all I’m going to do, but it’s probably not going to get to the point where I will need the load balancing for awhile. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 15:25 Wouldn’t this add extra latency to the pipeline? ---------------------------------------------------------------------- rocket1420 · 2023-09-28 15:34 I just run pihole in docker. ---------------------------------------------------------------------- rocket1420 · 2023-09-28 15:36 Docker is not next level. If you don't know what you'll be running, we certainly can't tell you the best way to run it. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 15:49 Yeah, from everything I’ve read Synology is great as long as you don’t dig yourself too deep into their walled garden. I’ll be using 3rd party alternatives for some stuff, like nextcloud. ---------------------------------------------------------------------- Xiakit · 2023-09-28 16:08 I use traefik so far as a reverse proxy, never had any issues with latency. I even use traefik to do ssl for my NAS. But the main question is, do you really want remote access on all the services? I have most of them geoblocked and the others use cloudflare, some use both. Also done in Traefik. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 16:20 I guess I don’t need remote access for most things. I may want to access media while traveling, but not most of the time. I think the only things I really want remote access to are the personal cloud stuff to replace Google. In fact, photos is what sold me on Synology, since it seems like they have the best alternative to Google photos with a mobile app that my family might actually not mind using instead. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 16:29 Docker isn’t next level, kubernetes clustering is. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 16:42 Well, pihole is a prime candidate for redundancy. Which I guess I can still have between the NAS and the NUC, but based on the feedback so far it sounds like I should keep the NAS dedicated to storage related services and any first party apps I want to run and do everything else on the NUC, leaving not much for the Pi to do except to add redundancy for the services that need it. ---------------------------------------------------------------------- Xiakit · 2023-09-28 16:54 If you trust Synology you can just follow their guides. There is a reverse proxy feature too and easy to setup SSL. Later on you can still switch to a more complex setup, I did that too. Had everything on Synology and used it as a webproxy for all the other services. Later as I got more experienced with docker & traefik I switched the entry point to the NUC. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 17:10 Sounds like I got plenty of room to grow then, which is all I wanted by getting the NUC. I was just gonna build a desktop home server, but I knew that if I didn’t ease into it with plenty of wins along the way, I would lose interest. This seems like a better jumping off point. ---------------------------------------------------------------------- mimikater · 2023-09-28 19:23 Im running everything in 16 Containers on a ubuntu rpi4, everything is "as Code", mostly docker compose and its deployed with github actions. Love every bit of it. Rpi dies, just spin another one up, run the github runner Action and restore the backuped volumes for persistent data. Want to run another Service? Write the compose file, commit the change in the repo and 1 minute later everything is deployed. All Services are in a docker network, not reachable from my network. But there is a traefik reverse proxy, reachable to me, that is automatically configured with the docker compose files. It knows which service should be reachable and it's internal address and ports. Traefik also automatically gets letsencrypt certificates for the App URLs it delivers. I will soon buy a synology with a ryzen cpu and then shift the workload to it, selling the raspberry. Rpi runs fine, backing up the volumes with duplicati also runs fine. But everything is way more comfortable on the synology. Even after switching from sd card to SSD, i had one SSD broke down on it. Im running homeassistant and evcc.io, which controls the charging of my EV, when the Sun is shining and i would otherwise sell the power for cheap. So i need a stable 24/7 solution, but a failover cluster would be a bit too much. Synology with 2 SSD drives should provide enough reliability, backing it up is easy, 2 rotating USB disks where one always stays at my fathers house, encrypted. Should be fine for years. ---------------------------------------------------------------------- Product-Extreme · 2023-09-28 19:26 I'd use the raspberry pi to host services you'd like redundancy for and use something like gravity sync when possible so changes on the primary services reflect on the backups. ---------------------------------------------------------------------- puppetjazz · 2023-09-28 19:41 I have a similar set up. I have four 8tbs on a nuc (two for data two for rsync copies) that runs jellyfin, azeroth core, and samba. A pi with four additional 8tbs (same hdd configuration) it's basically just running a nfs service and qbittorrent. I use UFW for security and cloudflare. Probably forgot something but I'm mid shift and exhausted lol ---------------------------------------------------------------------- Your-Neighbor · 2023-09-28 20:08 I have/am building a very similar setup Nas: presenting smb shares to the network with truenas Pi: router/firewall with a USB Ethernet dongle and openwrt Sff computer: literally everything else in proxmox In my opinion things that need to just work without thinking about should be their own devices and do as little as possible. I can still do work and go on with life if my proxmox machine goes down, but I can't say that as confidently about my nas or my router ---------------------------------------------------------------------- DeadOfKnight · 2023-09-28 22:15 Yeah, I have a separate router. Realistically the Pi and the NUC are toys. I wanted a nas setup first and foremost for self hosting, but these are to play around and learn all I can do. If I play around enough with them though, I might learn to rely on at least one being active. ---------------------------------------------------------------------- Nagashitw · 2023-09-28 22:23 Yeah don't use swarm. It is dead tech. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-29 01:51 Nothing wrong with installing and running native apps normally, but the more I learn about the benefits of containers, the less I can blame anyone for never wanting to go back. ---------------------------------------------------------------------- DeadOfKnight · 2023-09-29 01:53 Yeah, it was killed off by RAID ---------------------------------------------------------------------- puppetjazz · 2023-09-29 01:55 I've used containers and I'm not knocking them. I work remotely on a group project that is using several VMs. My home network simply doesn't call for much more than I have (could always use more hard drives though). ---------------------------------------------------------------------- DeadOfKnight · 2023-09-29 02:01 Well, tbf I think Windows needs containers more than Linux does, even though most people using them seem to be on Linux. Windows installers are far more notorious for doing things you don’t want, and leave behind a lot more after uninstall. ---------------------------------------------------------------------- puppetjazz · 2023-09-29 02:04 I agree with your statement and I hope you enjoy your project. Most of the time, that's more important if it's a home application. ---------------------------------------------------------------------- decstation · 2023-09-29 02:54 Be prepared for a lot of updating.... ---------------------------------------------------------------------- hdp0 · 2023-09-29 05:04 If using docker, check out orbital sync ---------------------------------------------------------------------- DeadOfKnight · 2023-09-29 17:56 Can’t that be automated? ---------------------------------------------------------------------- decstation · 2023-09-30 04:58 Whilst a lot of general updating can be automated you still need to be wary of the cve's that come out so you can take action as fast as possible. Action might include taking the service down until there is a fix if it is serious enough.. Also, you don't necessarily want to update everything at once in case it breaks. This is the reason I have three Proxmox servers. So I can update one but still have enough capacity to run everything if it all turns to crap. I'm currently trialing Proxmox 8 before rolling that onto the other systems You also want good backups. My Nextcloud install is one that sometimes breaks when updating and I have so far always managed to fix it but I want the option to be able to restore if needed. Trust me, when people do start to use and depend on what you build they will scream when it isn't working. But, have fun!