Spotlight

Scaling Dagster on Kubernetes: Best Practices for 50+ Code Locations

Maciej Lopalewski

This article discusses scaling Dagster to 50+ code locations on Kubernetes and covers architectural considerations for resource isolation, deployment strategies, and managing large-scale data pipeline orchestration.

More articles →

Tools and utilities

More projects →

Events starting soon

Discover more events onn Kube Events →

A Journey Through Kafkian SplitDNS in a Multitenant Kubernetes
A Journey Through Kafkian SplitDNS in a Multitenant Kubernetes

Fabián Sellés Rosa, Tech Lead of the Runtime team at Adevinta, walks through a real engineering investigation that started with a simple request: allowing tenants to use third-party Kafka services. What seemed straightforward turned into a complex DNS resolution problem that required testing seven different approaches before a working solution was found.

You will learn:

  • Why Kafka's multi-step DNS resolution creates unique challenges in multi-tenant environments, where bootstrap servers and dynamic broker lists complicate standard DNS approaches
  • The iterative debugging process from Route 53 split DNS through Kubernetes native pod DNS config, custom DNS servers, Kafka proxies, and CoreDNS solutions
  • How to implement the final solution using node-local DNS and CoreDNS templating with practical details including ndots configuration and Kyverno automation
  • Platform engineering evaluation criteria for assessing solutions based on maintainability, self-service capability, and evolvability in multi-tenant environments

Learn from production

More case studies →

Matching jobs

    • DevOps Engineer with BEDI Partnerships

    • Salary: $190.4K to $238K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, Helm, ArgoCD, Python, Go, Kotlin, Java, MySQL, DynamoDB

    • DevOps Engineer with Regard

    • Salary: $140K to $175K a year

    • Location: based in the office (and remote from home) in New York City, NY, USA

    • Tech stack: Kubernetes, AWS, ArgoCD, Docker, Python, SQL, Shell, PostgreSQL, Redis, Pulumi

    • DevOps Engineer with SOFTSWISS

    • Salary: $27K to $344K a year

    • Location: fully remote

    • Tech stack: Kubernetes, Helm, Shell, Python, Go, PostgreSQL, Kafka, Terraform, Gitlab, Puppet

    • DevOps Engineer with Two Six Technologies

    • Salary: $104.4K to $211.8K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, Docker, Python, Javascript, Typescript, Terraform, Cloudformation, CDK, GitHub Actions

    • DevSecOps Engineer with The New York Times

    • Salary: $145K to $165K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, GCP, Go, Python, Terraform

Discover more Kubernetes jobs on Kube Careers →

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 165 issues and counting.

or subscribe via

Build something

More tutorials →

Call for Papers closing soon

  1. 6

    days

    Devopsdays Atlanta

    The Call For Paper is open until 19 January 2026 at GMT-5. More info →
    • Location: Atlanta, GA, USA

    • In-person conference organized by Devopsdays.

    • The conference starts on the 21 April 2026.

    • Apply here
  2. 13

    days

    Observability Summit North America

    The Call For Paper is open until 26 January 2026 at GMT-5. More info →
    • Location: Minneapolis, MN, USA

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 22 May 2026.

    • Apply here
  3. 18

    days

    Devopsdays Zurich

    The Call For Paper is open until 31 January 2026 at GMT-5. More info →
    • Location: Zurich, CH

    • In-person conference organized by Devopsdays.

    • The conference starts on the 6 May 2026.

    • Apply here
  4. 18

    days

    Devopsdays Prague

    The Call For Paper is open until 31 January 2026 at GMT-5. More info →
    • Location: Prague, CZ

    • In-person conference organized by Devopsdays.

    • The conference starts on the 29 April 2026.

    • Apply here
  5. 18

    days

    Devopsdays Copenhagen

    The Call For Paper is open until 31 January 2026 at GMT-5. More info →
    • Location: Copenhagen, DK

    • In-person conference organized by Devopsdays.

    • The conference starts on the 28 April 2026.

    • Apply here
  6. 20

    days

    KubeCon + CloudNativeCon India 2026

    The Call For Paper is open until 1 February 2026 at GMT-5. More info →
    • Location: Mumbai, IN

    • In-person conference organized by CNCF.

    • The conference starts on the 19 June 2026.

    • Apply here
  7. 20

    days

    Web Days Convention

    The Call For Paper is open until 2 February 2026 at GMT-5. More info →
    • Location: Aix-en-Provence, FR

    • In-person conference organized by Web Days.

    • The conference starts on the 6 February 2026.

    • Apply here

Thanks to our sponsors who make Kube Today possible

Find out more about being a sponsor →

More articles

Even more articles →