Spotlight

Deploy LLM Models on OpenShift

Ahmed Draz

This tutorial shows how to deploy LLM models on OpenShift without operators by using llama.cpp with a quantized GGUF model, building a multi-stage container image, and exposing it via standard Kubernetes resources.

More articles →

Tools and utilities

  • kubecfg: kubeconfig CLI tool

    kubecfg is a CLI tool for managing Kubernetes kubeconfig files with fast context switching, namespace management, and multi-config merging through an interactive terminal UI.

  • Infralens: eBPF observability

    InfraLens is a zero-instrumentation observability tool that uses eBPF to automatically discover and visualize service-to-service communication in Kubernetes clusters without requiring code changes or sidecars.

  • OpenKruise Agents: AI agent sandbox

    OpenKruise Agents manage AI agent workloads in Kubernetes, providing rapid resource provisioning via pooling, sandbox hibernation with checkpoint support, and user session management with efficient traffic routing.

  • Gonzo: TUI log analysis

    Gonzo lets you use a terminal UI to stream and analyse logs in real time, with support for OpenTelemetry (OTLP), AI-powered insights, heatmaps and advanced filtering.

  • k9sight: Kubernetes TUI debugger

    k9sight is a Go TUI for debugging Kubernetes workloads with vim-style navigation, supporting log search, exec, port-forward, scale, restart, and built-in debug helpers for common pod failure states like CrashLoopBackOff and ImagePullBackOff.

More projects →

Events starting soon

Discover more events onn Kube Events →

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 150 issues and counting.

or subscribe via

Learn from production

More case studies →

Matching jobs

    • Data Engineer with Astranis

    • Salary: $29 a year

    • Location: based in the office in San Francisco, CA, USA

    • Tech stack: Kubernetes, Python, SQL

    • Data Engineer with Coface

    • Salary: $64.8K to $2.48L a year

    • Location: based in the office in Mumbai, IN

    • Tech stack: Kubernetes, Docker, SQL, Python

    • DevOps Engineer with AssureSoft

    • Salary: $90K to $198K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, GCP, ArgoCD, Terraform

    • DevOps Engineer with Avride

    • Salary: $54K to $325.49K a year

    • Location: based in the office in Austin, TX, USA

    • Tech stack: Kubernetes, AWS, Docker, C++, Python, GitHub Actions

    • DevOps Engineer with Candidly

    • Salary: $70.74K to $539K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, Azure, On-premise, Docker, Python, SQL, MySQL, Cloudformation, CDK

Discover more Kubernetes jobs on Kube Careers →

Thanks to our sponsors who make Kube Today possible

Find out more about being a sponsor →

Build something

More tutorials →

More articles

Even more articles →