Overview
Role Overview
We are looking for an experienced Data Platform Engineer / Kafka & Kubernetes Developer with strong expertise in designing, configuring, deploying, and managing Kafka-based data platforms in cloud environments.
The ideal candidate should have hands-on experience with Apache Kafka, Kubernetes, Terraform, Azure/GCP, DevOps, and infrastructure automation. The role will involve deploying and maintaining Kafka infrastructure, automating infrastructure provisioning, managing Kubernetes environments, and supporting cloud-based data platform engineering initiatives.
Job Description
Kafka Platform Engineering
- Design, configure, deploy, and maintain Kafka infrastructure.
- Configure and manage Kafka components across development, test, and production environments.
- Support Kafka cluster configuration, topic management, brokers, partitions, replication, and security.
- Monitor Kafka infrastructure and troubleshoot performance and availability issues.
- Work with Confluent Control Center for monitoring, administration, and operational management.
- Support Kafka deployments and upgrades across cloud and Kubernetes environments.
Kubernetes & Containerization
- Deploy and manage Kafka components and related services on Kubernetes.
- Work with Kubernetes clusters for application and data platform deployments.
- Troubleshoot Kubernetes workloads, networking, resource utilization, and deployment issues.
- Support containerized infrastructure and application environments.
Infrastructure as Code / Terraform
- Develop and maintain Terraform scripts for infrastructure provisioning.
- Automate deployment and configuration of Kafka and cloud infrastructure.
- Build reusable Terraform modules and follow infrastructure-as-code best practices.
- Integrate Terraform with shell scripts and DevOps workflows.
Cloud & DevOps
- Work with cloud platforms including Microsoft Azure and Google Cloud Platform (GCP).
- Deploy and manage data platform infrastructure across cloud environments.
- Build and maintain DevOps automation for infrastructure and application deployments.
- Support CI/CD and infrastructure automation initiatives.
- Implement monitoring, security, and operational best practices.
Skills & Requirements
Data Platform
Infrastructure Engineering
Apache Kafka.
Kafka components
Confluent Control Center.
Kubernetes
Terraform
Apply Now