A short post regarding moving away from docker swarm and to k3s.
I had high hopes for docker swarm but due to lack of integrated tools for:
- observability
- logs
- secure runtime (such as kata or gvisor)
- csi drivers
- native gitops like flux for k8s
- native load balancers and general administration is also little difficult.
These are only specific to swarm. docker-compose is still fantastic and I have no complaints of it.
As I am currently running k3s at home as well, it should be easy to move things. I wish to run cilium but due to it’s high resource usage, I might stick to default CNIs. Let’s see.
Anyway, I am planning to do the migration in the next month and sadly, a downtime of few days or even a week is expected. I plan on keeping normal nginx infront which would certainly make things quick to migrate and ingress-nginx will handle the internal routing.