Kafka & Kubernetes Developer / Data Platform Engineer

Overview

Role Overview

We are looking for an experienced Data Platform Engineer / Kafka & Kubernetes Developer with strong expertise in designing, configuring, deploying, and managing Kafka-based data platforms in cloud environments.

The ideal candidate should have hands-on experience with Apache Kafka, Kubernetes, Terraform, Azure/GCP, DevOps, and infrastructure automation. The role will involve deploying and maintaining Kafka infrastructure, automating infrastructure provisioning, managing Kubernetes environments, and supporting cloud-based data platform engineering initiatives.

Job Description

Kafka Platform Engineering

  • Design, configure, deploy, and maintain Kafka infrastructure.
  • Configure and manage Kafka components across development, test, and production environments.
  • Support Kafka cluster configuration, topic management, brokers, partitions, replication, and security.
  • Monitor Kafka infrastructure and troubleshoot performance and availability issues.
  • Work with Confluent Control Center for monitoring, administration, and operational management.
  • Support Kafka deployments and upgrades across cloud and Kubernetes environments.

Kubernetes & Containerization

  • Deploy and manage Kafka components and related services on Kubernetes.
  • Work with Kubernetes clusters for application and data platform deployments.
  • Troubleshoot Kubernetes workloads, networking, resource utilization, and deployment issues.
  • Support containerized infrastructure and application environments.

Infrastructure as Code / Terraform

  • Develop and maintain Terraform scripts for infrastructure provisioning.
  • Automate deployment and configuration of Kafka and cloud infrastructure.
  • Build reusable Terraform modules and follow infrastructure-as-code best practices.
  • Integrate Terraform with shell scripts and DevOps workflows.

Cloud & DevOps

  • Work with cloud platforms including Microsoft Azure and Google Cloud Platform (GCP).
  • Deploy and manage data platform infrastructure across cloud environments.
  • Build and maintain DevOps automation for infrastructure and application deployments.
  • Support CI/CD and infrastructure automation initiatives.
  • Implement monitoring, security, and operational best practices.

Skills & Requirements

Data Platform

Infrastructure Engineering

Apache Kafka.

Kafka components

Confluent Control Center.

Kubernetes

Terraform

 

Apply Now

Join Our Community

Let us know the skills you need and we'll find the best talent for you