This all makes sense to me since we deal with it at work. I would maybe add a service vs route point to differentiate things like UI that need external exposure. The main difference is we use kustomize instead of helm. Out of curiosity if you had any experience with both and why did you settle in helm?
Comment on Fediverse Apps on Kubernetes?
scrubbles@poptalk.scrubbles.tech 6 months agoI start simple with mine. Start with the deployment, just getting the pod up and running, completely stateless. Get that stabilized, once that’s happy then start moving onto the service, connecting to the UI. Then I finish anything else I can before adding in state - environment variables (first just in the deployment, then once that’s done worry about a config map and secrets). (Adding volumes in just complicates it because then you have to reset those volumes if you want to go back to a clean state).
As a list:
- Deployment (stateless) - get to not crash
- Service - connect to it
- Environment variables, extracting out what can be
- Secrets, adding those to the chart
- Volumes, adding in state
- Move to a nice clean setup with a clean values.yaml.
Finally, once your happy, then make it conform to other standards. Getting it stood up in k8s is the hard part, then customizing can come after.
ChapulinColorado@lemmy.world 5 months ago
jax@lemmy.cloudhub.social 6 months ago
That’s actually super helpful! I haven’t done much custom Helm chart-ing, and was kinda lost where to start. That really helps break the process down, and the tip about skipping state to start is very wise.
scrubbles@poptalk.scrubbles.tech 6 months ago
I’ve done… an annoying amount of them now. I hope my trials help you.
Be ready, it’s a very annoying and slow process, watching logs, figuring out why things are failing, debugging, githubs, everything. I just did one last week that was saying that it couldn’t write to /etc/passXXXXX, and it took 2 hours to track down that there was an optional command I could pass in that would change the running user of the container I was running (separate from the kube user). It’s a slog, but when you get it running it’s a rush of endorphins.
Biggest thing - kubernetes is a read-only file system compared to docker. So, for good devs they minimize writes to the filesystem unless they have to, and keep them localized. For bad devs, they write everywhere - and that gets sticky fast. So, if you’re getting write errors, know that there’s probably another volume you need to attach. The kicker is knowing which ones can be an
emptyDir
scratch directory and which ones actually need to persist. If you have adocker-compose
file it’s a great place to start, just set all the volumes toemptyDir
to start off with.Good luck!
jax@lemmy.cloudhub.social 6 months ago
I think both of the ones I mentioned have
docker-compose
files, which I think I can convert withkompose convert
? I guess from there I would follow your steps and then start parameterizing it once it’s running properly.