Post APuO12rrcliRmdtLsW by sleepytuxedo@mas.to
(DIR) More posts by sleepytuxedo@mas.to
(DIR) Post #APuC9WzwHmGU66wtJw by y3mz@mastodon.tech
2022-11-23T19:45:17.745640Z
0 likes, 0 repeats
- eng: why are you building c2 #infrastructure ?- me: because i can?- eng: but why did you choose #docker swarm over #kubernetes- me: are you meaning docker swarm?- eng: yes, i see docker installed on your #NixOS build pipeline- me: do you like hashi?- eng: the cereal?- me: that's kashi. i meant #hashicorp- eng: hashicorp didn't create docker swarm!- me: correct, look close... you might feel nomadic- eng: i'm not seeing it- me: can you approve pr?- eng: where is nomad?- me: line 41 in module- eng: why are you using nomad?- me: simple. i get to answer nice questions from you and practise my people skills
(DIR) Post #APuMivUkCKuxkZsFkW by sleepytuxedo@mas.to
2022-11-23T21:25:59Z
0 likes, 0 repeats
@y3mz so if I follow, Nomad is like Docker Swarm but better? I haven’t tried Nomad. How does it compare to k8s ? Thanks :)
(DIR) Post #APuMivyAQwSBDpdkbw by y3mz@mastodon.tech
2022-11-23T21:43:41.868184Z
0 likes, 0 repeats
this is one of those explanations that could take half a gb of disk space to go through. doesn't help that i'm obsessed with distributed computing so let's see if i can unpack.these are the times i wish i had infographic 😅 #swarm:- native mode to docker- works well single node, multi-master, master-worker model- limited storage options, (#glusterfs, nfs, local storage is prime, although #container based storage like seaweedfs will work (it's a tad slow at times)- can handle pretty much anything you can throw at it, but like anything distributed storage is the pain- cni is not really much of a thing as docker gives you a cigar-box full of options to plumb your net- node scaling is manual not auto (many of us don't have this need)- deployment autoscaling is possible, but requires warez to do it- claimed to be supported by docker, but with anything who knows- handles ~80% of most common use-cases- multi-arch support- ingress and proxy load balancing can be handled however you like (most use traefik i find, or at least i did)#nomad:- can deploy docker, containerd, podman, lxc, local-execution for tasks (think of tasks as stacks but they run until they shouldn't)- networking can be wrangled much like docker. (i.e. i have multiple nodes bound to wireguard on wg0 so it's like private cluster setup- storage options are local, nfs, gluster, docker volumes, and there's primitive support for csi drivers- service discovery/mesh can run via consul (and i encourage it)- ingress can be whatever you choose to deploy (#caddy, #traefik, #nginx, #haproxy)- multi-arch support (ie you can constrain a job to a node with the proper arch)- plugs into vault effortlessly for secrets- traefik is a first class citizen now with #hashicorp- i repeat, storage is still an issue on any distributed systemthe way i started to adopt nomad was that i had disparate machines in random places. i wanted them to be able to work in unison like a compute grid. nomad to me is a philosophical thing in that each agent node is like a nomad on a journey by itself. it reminded me of me. so i've been experimenting with it.i really hope hashicorp sends me a hat. one can never have too many hats. :-)
(DIR) Post #APuNOckOI8OZlg4kWe by sleepytuxedo@mas.to
2022-11-23T21:47:45Z
0 likes, 0 repeats
@y3mz thank you very much for the detail! If you had a choice between nomad or k8s what would you pick ?
(DIR) Post #APuNOlx848vsJn6Y88 by y3mz@mastodon.tech
2022-11-23T21:51:15.895216Z
0 likes, 0 repeats
like stuck on an island with endless pita, twilight zone episodes, and a choice between nomad and #kubernetes?i'd choose nomad. it's not better, it's just different and very simple. i'm too olde to do this fancy shvt anymore.
(DIR) Post #APuO12rrcliRmdtLsW by sleepytuxedo@mas.to
2022-11-23T21:56:12Z
1 likes, 0 repeats
@y3mz I’m trying to learn k8s for work and rather struggling with the complexity so I’m on the lookout for alternatives. Thank you so much for the great info. BTW you can never have too much pita bread ;)
(DIR) Post #APuO6CcgmXiRUFFkeW by y3mz@mastodon.tech
2022-11-23T21:59:09.596139Z
0 likes, 0 repeats
@sleepytuxedo cosigned on the pita. if you need help with k8s let me know. i also work with it however like to experiment.
(DIR) Post #APuh809nzzsCX6JY7U by sleepytuxedo@mas.to
2022-11-23T22:12:25Z
1 likes, 0 repeats
@y3mz thanks so much!