Learn Kubernetes Weekly issue 97 · 18 Sept 2024

Fairness aware load distribution, Kubernetes configuration in 2024, Container communication inside a pod, What determines a ready node?

This newsletter issue is brought to you by VictoriaMetrics — a fast and scalable open-source time series database and monitoring solution.

Articles

  1. Fairness aware load distribution

    medium.com

    This article explores fairness-aware load distribution in Kubernetes, covering automatic rebalancing of customer data, flexible message processing, and failed message handling.

  2. The rise of open source time series databases

    victoriametrics.com

    The number of active TimeSeries in databases like VictoriaMetrics is critical to performance.

    Imagine your app generates 2 million time series from just a few labels—without the right tools, this could cause significant slowdowns.

    sponsored

  3. Kubernetes configuration in 2024

    medium.com

    This article revisits the state of Kubernetes configuration tools in 2024.

    The author notes that while the tools have matured, the user experience has not changed dramatically over the past 7 years, leaving room for innovation in the space.

  4. Container communication inside a Kubernetes pod

    medium.com

    Learn how containers in a pod share the same network namespace and IP address and can communicate using shared volumes, inter-process communications (IPC), and the loopback interface facilitated by the pause container.

  5. What determines if a Kubernetes node is ready?

    trstringer.com

    The article discusses what determines if a Kubernetes node is ready, specifically the kubelet's checks: the container runtime, CSI provider, CPU, memory, max pods, network, and pod lifecycle event generator.

  6. Do pods really get evicted due to CPU pressure?

    awsmorocco.com

    This article explores the concept of pods getting evicted due to CPU pressure on a node.

    It discusses how CPU throttling prevents pods from monopolizing CPU resources, while node pressure eviction occurs when a node runs out of critical resources.

Articles worth checking out:

Reduces monitoring costs by 5x

VictoriaMetrics

VictoriaMetrics Cloud is a hosted monitoring platform and managed service for metrics that allows organizations to monitor and store large amounts of time-series data without running the underlying infrastructure.

Try it for free

Reduces monitoring costs by 5x

Tutorials

  1. How to reduce expenses on monitoring: be smarter about data

    victoriametrics.com

    Monitoring can get expensive due to the huge amounts of data that need processing.

    In this blog post, you'll learn how to store and process monitoring metrics to reduce costs and how VictoriaMetrics can help.

    sponsored

  2. ImagePolicy webhook in Kubernetes

    pramodhm112.medium.com

    This article explains how to create a webhook server to handle ImagePolicy validation and the behaviour of the ImagePolicy webhook, including the rules section that defines API operations and resources to intercept.

  3. Turbocharge ArgoCD with app of apps pattern and kustomized Helm

    medium.com

    Read about implementing the app of apps pattern in ArgoCD using the Helm template command.

    This example builds on the Guestbook app, a project inspired by ArgoCD's documentation and comprised of four component microservices.

  4. Backup k3s with litestream

    inovex.de

    This guide describes how to perform a backup of k3s cluster using Litestream.

    It explains the litestream restore command and -if-db-not-exists flag, which allows the restoration of a database only if one is not already present.

Tortoise: outpacing the optimization challenges in Kubernetes

In this KubeFM episode, Kensei Kanada discusses Tortoise, an open-source project he developed at Mercari to tackle Kubernetes resource optimization challenges. He explains the limitations of existing solutions like Horizontal Pod Autoscaler (HPA) and Vertical Pod Autoscaler (VPA), and how Tortoise aims to provide a more comprehensive and automated approach to resource management in Kubernetes clusters.

You will learn:

  • The complexities of resource optimization in Kubernetes, including the challenges of managing HPA, VPA, and manual tuning of resource requests and limits
  • How Tortoise automates resource optimization by replacing HPA and VPA, reducing the need for manual intervention and continuous tuning
  • The technical implementation of Tortoise, including its use of Custom Resource Definitions (CRDs) and how it interacts with existing Kubernetes components
  • Strategies for adopting and migrating to new tools like Tortoise in a large-scale Kubernetes environment
Tortoise: outpacing the optimization challenges in Kubernetes

Kubernetes jobs

    • Site Reliability Engineer with Vimeo

    • Salary: $127.8K to $196K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, AWS, GCP, ArgoCD, Go, Python, Java, PHP, Ruby, C++

    • DevOps Engineer with Sierra Space

    • Salary: $104.83K to $144.14K a year

    • Location: based in the office in Centennial / Broomfield / Louisville, CO, USA

    • Tech stack: Kubernetes, AWS, Azure, GCP, On-premise, Docker, Shell, Python, C++, C

    • Site Reliability Engineer with Everwest

    • Salary: €40.8K to €52.8K a year

    • Location: based in the office in Vilnius, LT

    • Tech stack: Kubernetes, AWS, Azure, On-premise, Docker, Python, C#, Powershell, Terraform, Ansible

Discover more Kubernetes jobs on Kube Careers →

Code & tools

  1. Kubernetes-WithOut-Kubelet

    github.com/kubernetes-sigs

    KWOK (Kubernetes-WithOut-Kubelet) is a toolkit that enables setting up a cluster of thousands of nodes in seconds.

    Under the scene, all Nodes are simulated to behave like real ones, so the overall approach employs a pretty low resource footprint.

  2. Kobs: Kubernetes observability platform

    github.com/kobsio

    Kobs is an application-centric observability platform for Kubernetes and Cloud workloads based on Custom Resource Definitions.

  3. Shell operator

    github.com/flant

    Shell-operator provides an integration layer between Kubernetes cluster events and shell scripts by treating scripts as hooks triggered by events.

  4. Kamaji: control plane manager

    github.com/clastix

    Kamaji is a tool aimed to build and operate a Managed Kubernetes Service with a fraction of the operational burden.

    With Kamaji, you can deploy and operate hundreds of Kubernetes clusters as a hyper-scale cloud provider.

  5. Chart-testing: linting and testing charts

    github.com/helm

    ct is a tool for testing Helm charts.

    It is meant for linting and testing pull requests and automatically detects charts changed against the target branch.

Other interesting projects:

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 150 issues and counting.

or subscribe via

Upcoming Kubernetes events

  1. Sept

    24

    Kubernetes Community Days Washington DC 2024

    In-person conference organized by KCD Washington DC.

    • Location: Washington, DC, USA

    • This is a free event.

  2. Sept

    18

    GPUs in Kubernetes: past, present, and future

    Online meetup organized by Platformers Community.

    • This is a virtual event

    • This is a free event.

  3. Sept

    24

    Edgecase 2024

    In-person conference organized by Fullstaq.

    • Location: Amersfoort, NL

    • This event requires an entrance fee

  4. Sept

    18

    Towards standardized volumes: transitioning Odin's volume management to Kubernetes

    In-person meetup organized by Cloud Native Aarhus.

    • Location: Aarhus, DK

    • This is a free event.

  5. Sept

    21

    Backstage and Crossplane & delivery strategies with Argo CD and Kubernetes

    In-person meetup organized by Cloud Native Coimbatore.

    • Location: Coimbatore, IN

    • This is a free event.

Discover more Kubernetes events on Kube Events →

Thanks to our sponsors who make Kube Today possible

  • LearnKube
  • Akamai
  • Fairwinds
  • Densify
Find out more about being a sponsor →

Kubernetes call for papers

  1. expired

    Dutch Cloud Native Day 2024

    The Call For Paper was open until 31 October 2024 at UTC. More info →
    • Location: Amsterdam, NL

    • In-person conference organized by Cloud Native Amsterdam.

    • The conference starts on the 10 December 2024.

    • Apply here
  2. expired

    Tech Internals Conf

    The Call For Paper was open until 1 November 2024 at UTC. More info →
    • Location: Berlin, DE

    • In-person conference organized by TIC.

    • The conference starts on the 27 February 2025.

    • Apply here
  3. expired

    Cloud Native Sustainability Week 2024

    The Call For Paper was open until 24 September 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by CNCF.

    • The conference starts on the 8 October 2024.

    • Apply here
  4. expired

    DevSecOps 2024

    The Call For Paper was open until 4 November 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by Conf42.

    • The conference starts on the 5 December 2024.

    • Apply here
  5. expired

    QCon San Francisco

    The Call For Paper was open until 18 September 2024 at UTC. More info →
    • Location: San Francisco, CA, USA

    • In-person conference organized by InfoQ.

    • The conference starts on the 18 November 2024.

    • Apply here
  6. expired

    Cybersec Asia 2025

    The Call For Paper was open until 30 November 2024 at UTC. More info →
    • Location: Bangkok, TH

    • In-person conference organized by Cybersec Asia.

    • The conference starts on the 29 January 2025.

    • Apply here
  7. expired

    Devopsdays Chicago

    The Call For Paper was open until 20 October 2024 at UTC. More info →
    • Location: Chicago, IL, USA

    • In-person conference organized by Devopsdays.

    • The conference starts on the 18 March 2025.

    • Apply here
  8. expired

    RuhrSec 2025

    The Call For Paper was open until 10 November 2024 at UTC. More info →
    • Location: Bochum, DE

    • In-person conference organized by Hackmanit.

    • The conference starts on the 21 February 2025.

    • Apply here
  9. expired

    DevIgnition

    The Call For Paper was open until 27 September 2024 at UTC. More info →
    • Location: Washington, DC, USA

    • In-person conference organized by DevIgnition.

    • The conference starts on the 7 November 2024.

    • Apply here

Until next time!

— Dan

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 150 issues and counting.

or subscribe via