Recommendations for scalable storage, multi-node and load balancing on
k8s?
reddit / selfhosted

----------------------------------------------------------------------
aDataWat · 2023-10-10 13:47

Hey everyone, was hoping for some help as I try and scale a small
business using #kubernetes

We provide a service where each client is allocated their own instance
of a database on Kubernetes. Currently, we utilize hostPath storage by
mounting a local directory on the node to store data. However, we've
realized that this setup may not scale well as we plan to add more
nodes to our cluster.

We've explored High Availability and Mayastor for on-node distributed
storage, but these require a minimum of three nodes. While this could
be a viable path, it necessitates a load balancer in front of the
nodes which is an additional consideration.

We do currently plan on going from 1 server to 2, so we recognise that
HA won't be available for us right now

We are now actively seeking advice on:

1.Alternative storage solutions that would facilitate smooth scaling
as we add a second node, and potentially more nodes in the future.

Effective strategies for load balancing in a multi-node setup.

Any experiences or insights on transitioning from a single-node to a
multi-node setup, particularly focusing on data storage and
management.

Your suggestions and recommendations on potential solutions or
improvements to our current setup would be amazing

----------------------------------------------------------------------
ElevenNotes · 2023-10-10 18:40

vSAN ESA NFS for K8s with storage class policies is probably the
easiest and one of the fastest. JuiceFS is another.

----------------------------------------------------------------------
desqviewX · 2023-10-14 15:22

You want Longhorn: https://longhorn.io/

2 nodes is always going to be problematic due to quorum, but you can
do 2 with Longhorn or GlusterFS.

The suggestion for "vSAN" won't work, you need VMware deployed, plus a
minimum of 3 node, but really 4.