Learn Kubernetes Weekly issue 98 · 25 Sept 2024

AWS VPC Flow Logs, NAT Gateways, and pods, How does a Docker container work?, Kubernetes fine-grained HPA, TRUE Argo CD diff

This newsletter is sponsored by StormForge – Double your Kubernetes resource utilization and unburden developers from sizing complexity with the first HPA-compatible vertical pod rightsizing solution. Try it for free.

Articles

  1. AWS VPC Flow Logs, NAT Gateways, and Kubernetes pods :  a detailed overview

    itnext.io

    This article explains how to track traffic through a NAT Gateway in an AWS VPC, specifically focusing on Kubernetes Pods.

    You'll learn how to use VPC Flow Logs to monitor traffic and how to deploy and configure pods to work with NAT Gateways.

  2. Technical guide to the Horizontal Pod Autoscaler

    stormforge.io

    This comprehensive guide walks through setting up, configuring, and observing the HPA under various load scenarios through a practical demonstration.

    You'll learn common obstacles and advanced HPA implementation tools in production environments.

    sponsored

  3. How does a Docker container work internally?

    dev.to

    Learn how a namespace makes a container feel like another operating system and how to create a container from scratch with Go.

    You will also see how to set the hostname automatically inside the container.

  4. Kubernetes fine-grained horizontal pod autoscaling with Container Resource Metrics

    engineering.doit.com

    Kubernetes 1.30 stabilizes Container resource metrics in HPA, allowing scaling based on individual container metrics.

    Learn how this feature enables efficient resource allocation and prevents unnecessary scaling due to non-critical containers.

  5. Rendering the TRUE Argo CD diff on your PRs

    dev.to

    Learn how to display the true Argo CD diff on your pull requests, and how to use the argocd-diff-preview tool to verify that your configuration is correct.

  6. What is the difference between a root process and a containerized root process?

    www.armosec.io

    Learn the differences between a process running as root (UID 0) and a containerized process running as root, and discover why running containerized root processes can increase security risks.

Articles worth checking out:

Double Kubernetes efficiency to optimize cost & performance

StormForge

Continuously rightsize workloads and unburden developers from sizing complexity with the first HPA-compatible vertical pod rightsizing solution.

Start a free trial or play around in the sandbox environment (no form fill required).

Double Kubernetes efficiency to optimize cost & performance

Tutorials

  1. How to pair cost monitoring with automated workload rightsizing Using Kubecost and Optimize Live

    stormforge.io

    Walk through how to install free versions of Kubecost, for cost monitoring, and Optimize Live, for automated workload optimization.

    You'll see how to get a snapshot of potential savings, optimize a workload, and then see costs go down.

    sponsored

  2. How to deploy a self-hosted LLM on EKS and why you should

    medium.com

    Learn how to deploy an LLM on EKS.

    The tutorial will guide you through the process of setting up the necessary tools, including Karpenter and CoreDNS and deploying a specific LLM model using HuggingFace.

  3. Istio multicluster with multiple network using istio-gateway

    medium.com

    This tutorial guides you through deploying Istio multicluster with multiple networks.

    You'll learn to expose services and set up a multicluster (multi-primary) environment with multiple networks.

  4. Using Git for a Helm chart Repo

    community.ops.io

    This article explains how to use Git for a Helm chart repository.

    It provides a step-by-step guide on how to create a Helm chart repository using Git and how to install charts from the repository after updating it with the helm repo update command.

Configuring requests & limits with the HPA at scale

Alexandre Souza, a senior platform engineer at Getir, shares his expertise in managing large-scale environments and configuring requests, limits, and autoscaling.

He explores the challenges of over-provisioning and under-provisioning and discusses strategies for optimizing resource allocation using tools like Horizontal Pod Autoscaler (HPA) and Vertical Pod Autoscaler (VPA).

You will learn:

  • How to set appropriate resource requests and limits to balance application performance and cost-efficiency in large-scale Kubernetes environments.
  • Strategies for implementing and configuring Horizontal Pod Autoscaler (HPA), including scaling policies and behavior management.
  • The differences between CPU and memory management in Kubernetes and their impact on workload performance.
  • Techniques for leveraging tools like KubeCost and StormForge to automate resource optimization.
Configuring requests & limits with the HPA at scale

Kubernetes jobs

    • Software Engineer with Teragonia

    • Salary: $200K to $225K a year

    • Location: based in the office (and remote from home) in Chicago, IL, USA

    • Tech stack: Kubernetes, GCP, Python, SQL, Javascript, Typescript, PostgreSQL

    • Software Engineer with Domain Tools

    • Salary: ₱1.38M to ₱2.3M a year

    • Location: remote from Philippines, Colombia

    • Tech stack: Kubernetes, AWS, Docker, Go, Shell, Python, Scala, PHP, Rust, C++

    • Site Reliability Engineer with Perplexity AI

    • Salary: $200K to $240K a year

    • Location: based in the office in San Francisco, CA, USA

    • Tech stack: Kubernetes, AWS, Docker, Python, DynamoDB, Redis, PostgreSQL, Terraform

    • Software Engineer with Stream Data Centers

    • Salary: $100K to $125K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, AWS, Azure, Data center, Docker, SQL, Javascript, Java, Typescript, PostgreSQL

    • Software Engineer with Stream Data Centers

    • Salary: $100K to $125K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, AWS, Azure, Data center, Docker, SQL, Javascript, Java, Typescript, PostgreSQL

Discover more Kubernetes jobs on Kube Careers →

Code & tools

  1. Kube-vip: virtual IP and load balancer

    kube-vip.io

    kube-vip provides Kubernetes clusters with a virtual IP and load balancer for both the control plane (for building a highly-available cluster) and Kubernetes Services of type LoadBalancer without relying on external hardware or software.

  2. Kubefirst: GitOps infrastructure

    github.com/kubefirst

    Kubefirst is a cloud provisioning tool that creates a kubernetes cluster with automated Infrastructure as Code, GitOps asset management and application delivery, secrets management, and more.

  3. Seabird: Kubernetes IDE

    github.com/getseabird

    Seabird is a Kubernetes IDE designed for the GNOME desktop.

    It has essential features such as a terminal for executing commands, monitoring through logs and metrics, and a resource editor that conveniently places the API reference at your fingertips.

  4. Skooner: Kubernetes dashboard

    github.com/skooner-k8s

    Skooner is a Kubernetes dashboard to manage your cluster.

  5. Kubelogin

    github.com/int128

    kubelogin is a kubectl plugin for Kubernetes OpenID Connect (OIDC) authentication, also known as kubectl oidc-login.

Other interesting projects:

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 150 issues and counting.

or subscribe via

Upcoming Kubernetes events

  1. Sept

    30

    Advanced Kubernetes course (London)

    In-person workshop organized by Learnk8s.

    • Location: London, GB

    • This event requires an entrance fee

  2. Sept

    27

    Kubernetes Community Days Porto 2024

    In-person conference organized by KCD Porto.

    • Location: Porto, PT

    • This is a free event.

  3. Sept

    26

    Kube Native 2024

    Online conference organized by Conf42.

    • This is a virtual event

    • This is a free event.

  4. Oct

    2

    Building an open-source platform for a 105-year-old company

    Online meetup organized by Platform Engineers Atlanta.

    • This is a virtual event

    • This is a free event.

  5. Sept

    26

    Practical tips for scaling in Kubernetes & KEDA in Action

    Online & in-person meetup organized by Cloud Native Prague.

    • Location: Prague, CZ and virtual

    • This is a free event.

Discover more Kubernetes events on Kube Events →

Thanks to our sponsors who make Kube Today possible

  • LearnKube
  • Akamai
  • Fairwinds
  • Densify
Find out more about being a sponsor →

Kubernetes call for papers

  1. expired

    Dutch Cloud Native Day 2024

    The Call For Paper was open until 31 October 2024 at UTC. More info →
    • Location: Amsterdam, NL

    • In-person conference organized by Cloud Native Amsterdam.

    • The conference starts on the 10 December 2024.

    • Apply here
  2. expired

    KubeCon + CloudNativeCon Europe 2025

    The Call For Paper was open until 25 November 2024 at UTC. More info →
    • Location: London, UK

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 1 April 2025.

    • Apply here
  3. expired

    Tech Internals Conf

    The Call For Paper was open until 1 November 2024 at UTC. More info →
    • Location: Berlin, DE

    • In-person conference organized by TIC.

    • The conference starts on the 27 February 2025.

    • Apply here
  4. expired

    Navigate North America 2025

    The Call For Paper was open until 1 October 2024 at UTC. More info →
    • Location: San Francisco, CA, USA

    • In-person conference organized by Civo.

    • The conference starts on the 10 February 2025.

    • Apply here
  5. expired

    DevSecOps 2024

    The Call For Paper was open until 4 November 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by Conf42.

    • The conference starts on the 5 December 2024.

    • Apply here
  6. expired

    Cybersec Asia 2025

    The Call For Paper was open until 30 November 2024 at UTC. More info →
    • Location: Bangkok, TH

    • In-person conference organized by Cybersec Asia.

    • The conference starts on the 29 January 2025.

    • Apply here
  7. expired

    Devopsdays Chicago

    The Call For Paper was open until 20 October 2024 at UTC. More info →
    • Location: Chicago, IL, USA

    • In-person conference organized by Devopsdays.

    • The conference starts on the 18 March 2025.

    • Apply here
  8. expired

    RuhrSec 2025

    The Call For Paper was open until 10 November 2024 at UTC. More info →
    • Location: Bochum, DE

    • In-person conference organized by Hackmanit.

    • The conference starts on the 21 February 2025.

    • Apply here
  9. expired

    DevIgnition

    The Call For Paper was open until 27 September 2024 at UTC. More info →
    • Location: Washington, DC, USA

    • In-person conference organized by DevIgnition.

    • The conference starts on the 7 November 2024.

    • Apply here

Until next time!

— Dan

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 150 issues and counting.

or subscribe via