What we learned after a year of GitLab.com on Kubernetes
For about a year now, the infrastructure department has been working on migrating all services that run on GitLab.com to Kubernetes. The effort has not been without challenges, not only with moving services to Kubernetes but also managing a hybrid deployment during the transition. We have learned a number of lessons along the way that we will explore in this post.https://about.gitlab.com/blog/2020/09/16/year-of-kubernetes
Rebuilding Linkerd's continuous integration (CI) with Kubernetes in Docker (kind) and GitHub Actions
In mid-2019, the Linkerd project’s continuous integration (CI) took 45 minutes, all tests were serialized on a single Kubernetes cluster, and multi-hour backups were common. A migration onto one-off Kubernetes in Docker (kind) clusters and GitHub Actions got CI below 10 minutes, and made it parallelizable.https://buoyant.io/2020/09/16/linkerds-ci-kubernetes-in-docker-github-actions
This post will detail Linkerd’s CI journey from a single, persistent Kubernetes cluster to theoretically unlimited one-off kind clusters. This journey includes a few detours on what patterns and tools worked well (and not so well) for Linkerd’s use case.
Authelia
Authelia is an open-source authentication and authorization server providing 2-factor authentication and single sign-on (SSO) for your applications via a web portal. It acts as a companion of reverse proxies like nginx, Traefik or HAProxy to let them know whether queries should pass through. Unauthenticated user are redirected to Authelia Sign-in portal instead.https://github.com/authelia/authelia
Arktos
Arktos is an open source project designed for large scale cloud compute infrastructure. It is evolved from the open source project Kubernetes codebase with core design changes.
https://github.com/centaurus-cloud/arktosPerforming a Live CNI Migration
As part of Jetstack’s Subscription offering, the assigned CRE (Customer Reliability Engineer) will carry out Proof of Concepts for validating and developing projects that your team can implement against your Kubernetes Cluster. One of our Subscription customers, Sky Betting and Gaming, tasked us with investigating whether it was possible to migrate the CNI solution for a Kubernetes cluster from Canal to Cilium, live.https://blog.jetstack.io/blog/cni-migration
In this post we’ll discuss why one might want to change CNIs, what I have learnt developing a solution for live migration, and how it all works.
Kotary
It is an operator that brings a layer of verification and policy to the native ResourceQuotas mechanism.https://github.com/ca-gip/kotary
Easier Troubleshooting of cert-manager Certificates
This post will explore the newest addition to the kubectl plugin of cert-manager, kubectl cert-manager status certificate, a command designed to make the troubleshooting experience of cert-manager problems easier.https://blog.jetstack.io/blog/cert-manager-status-cert
kip
Kip is a Virtual Kubelet provider that allows a Kubernetes cluster to transparently launch pods onto their own cloud instances. The kip pod is run on a cluster and will create a virtual Kubernetes node in the cluster. When a pod is scheduled onto the Virtual Kubelet, Kip starts a right-sized cloud instance for the pod’s workload and dispatches the pod onto the instance. When the pod is finished running, the cloud instance is terminated. We call these cloud instances “cells”.https://github.com/elotl/kip
cml
What is CML? Continuous Machine Learning (CML) is an open-source library for implementing continuous integration & delivery (CI/CD) in machine learning projects. Use it to automate parts of your development workflow, including model training and evaluation, comparing ML experiments across your project history, and monitoring changing datasets.https://github.com/iterative/cml
Achieving multi-tenancy in monitoring with Prometheus & the mighty Thanos Receiver
https://www.infracloud.io/blogs/multi-tenancy-monitoring-thanos-receiver
https://www.infracloud.io/blogs/multi-tenancy-monitoring-thanos-receiver
A Tale of Escaping a Hardened Docker container
https://www.redtimmy.com/docker/a-tale-of-escaping-a-hardened-docker-container
https://www.redtimmy.com/docker/a-tale-of-escaping-a-hardened-docker-container
Alerting on SLOs
At Glitch we’ve recently completed a project to migrate to SLO-based alerts. It’s too early to tell if this has been a success or not, but in this post I’ll write about our motivation for going down this route, and give an introduction to all the concepts you need to know, should you want to give it a go as well.https://mads-hartmann.com/sre/2020/09/08/alerting-on-slos.html
gitleaks
Gitleaks is a SAST tool for detecting hardcoded secrets like passwords, api keys, and tokens in git repos. Gitleaks aims to be the easy-to-use, all-in-one solution for finding secrets, past or present, in your code.https://github.com/zricethezav/gitleaks
KUBERNETES CLIENTS AND DASHBOARDS: A COMPARISON
https://ordina-jworks.github.io/cloud/2020/08/28/kubernetes-clients-comparison.html
https://ordina-jworks.github.io/cloud/2020/08/28/kubernetes-clients-comparison.html
Vouch Proxy
an SSO solution for Nginx using the auth_request module.https://github.com/vouch/vouch-proxy
Whispers
Whispers is a static code analysis tool designed for parsing various common data formats in search of hardcoded credentials and dangerous functions. Whispers can run in the CLI or you can integrate it in your CI/CD pipeline.https://github.com/Skyscanner/whispers
deepmux
deepmux is a PaaS solution to effortlessly deploy trained machine learning models on the cloud and generate predictions without setting up any hardware.
https://github.com/Deep-Mux/deepmux-python