Good VPS solution for off-site self hosted stack reddit / selfhosted ---------------------------------------------------------------------- SillyLilBear · 2023-11-28 12:14 I am looking to move a bulk of my docker containers offsite and use wireguard to access them. Anyone doing this with good success can recommend a provider? I am thinking about a 4 core 8g VPS from OVH which I think should be enough as that's roughly why my proxmox vm is. I think a dedicated server is overkill for now. Ideally, I would like to do k3s with the offsite the master with my LAN backup nodes, but I am not sure I want to get into that head ache for now, I can spin up another node and restore backups pretty quickly if needed. ---------------------------------------------------------------------- Docccc · 2023-11-28 12:49 i am a fan of hetzner. Specially their new shared ARM instances. ---------------------------------------------------------------------- chin_waghing · 2023-11-28 13:35 I'm going to be a huge ass and say, I wouldnt really call Nomad a competitor to k8s. It's not got as much market share. however before I get downvoted to last week, I am prepared to be proved wrong and sold on it ---------------------------------------------------------------------- chin_waghing · 2023-11-28 13:42 I've had hit and miss success with OVH. For some reason K3s would fail to install with some weird errors on their infra. This is probably fixed now. If you intend to use OVH, get familiar with their Openstack UI and then Openstack terraform provider as it makes storing everything in git and state alot easier. Hetzner I've not personally used, but lots of people preach about it. ​ RE K3s. Maybe I suck at english but from what you're saying it sounds like you want to host the control plane for k3s on prem and have a VPN to the nodes on the cloud? I would avoid this, Kubernetes gets a little _funky_ when high latency, pod status may not be reported properly etc. If that's not the case and you have the entire k3s cluster on your cloud provider of choice, then you'll be fine. One thing to note is Load balancing etc on your own cluster on a cloud provider can get a little tricky, but if you plane to just use `kind: service` with `type: ClusterIP` or using `nginx ingress` or `traefik` on the _lan_ on the cloud provider, and connect the 2 networks (home and cp) via VPN, you could get away with no fiddly LB. If you're not 100% set on k3s and rolling your own k8s, use the cloud providers managed solution, as they make life a little easier with things like storage CSI dirvers and LB controllers. I hope this helps at all? This was quite a word vomit so sorry if this just ruined everything ---------------------------------------------------------------------- SillyLilBear · 2023-11-28 13:45 Ideally I want to run everything on my LAN, but if my internet goes down (which happens a few times a year in the winter) certain containers get moved offsite as they need to continue to do their tasks. I was looking at some of the managed kubernetes options, but I wasn't really sure what I needed to get a basic 3 node setup going. ---------------------------------------------------------------------- Docccc · 2023-11-28 13:48 all depends on your needs. It does it job well for me without the management and resource overhead of k8 ---------------------------------------------------------------------- chin_waghing · 2023-11-28 13:50 Straight off the bat, I think getting the scheduling you want where if the connection goes down they get scheduled somewhere else without running in to a real PITA with k3s latency. best way would be run 3 \_master\_ nodes and schedule workloads on there, then have 2 in cloud and one on prem, plus a few workers on prem and the cloud. ​ The 3 control plane nodes allow for HA control plane, whilst preventing the DB getting out of sync and duplicates as there is always an odd number. ​ For the managed k8s options, I think Digital ocean are quite good, their docs seem to not suck which is always good. OVH k8s, never used so cant comment. ​ But as far as a 3 node cluster goes, if you value your free time ([unlike me who uses k8s at work and at home](https://documentation.breadnet.co.uk/kubernetes/)) use managed k8s. ---------------------------------------------------------------------- SillyLilBear · 2023-11-28 13:53 Isn't k3s suppose to be easier? That's the only reason I was thinking k3s. ---------------------------------------------------------------------- chin_waghing · 2023-11-28 14:01 K3s 100000% is easier if you're [self hosting it](https://breadnet.co.uk/kubernetes-at- home/?utm_source=reddit&utm_medium=comment&utm_campaign=good-vps) and managing it your self as it has a nice and simple to understand config file, without having to manage kubelet and kube-apiserver etc etc on its own. But if you're using a cloud providers k8s distro they manage all that garbage for you. As far as a learning opportunity goes, 100% roll your own k8s, but when you notice grey hairs dont say I didnt warn you! /s ---------------------------------------------------------------------- [deleted] · 2023-11-28 14:01 [removed] ---------------------------------------------------------------------- chin_waghing · 2023-11-28 14:03 Interesting, I think I will add it to my list of things to learn as I've only seen companies use it, then roll their own [fly.io moved off](https://community.fly.io/t/get-in-losers-were- getting-off-nomad/12914) ---------------------------------------------------------------------- [deleted] · 2023-11-28 16:27 [deleted] ---------------------------------------------------------------------- shaunjanssens · 2023-11-28 16:27 I'm also using Hetzner for a couple of years and never had any issues with it! And it's dirt cheap!