Tech Lead (Data Platform)

Overview

Technical Lead to architect, design, and lead the implementation of real-time data processing and data platform.

The ideal candidate will have deep expertise in Apache Kafka, time-series data platforms (such as InfluxDB, TimescaleDB, or OSI PI), and modern data streaming architectures. You will have strong skills in API development, messaging, and building connector frameworks to integrate with multiple enterprise and cloud systems.

Job Description

Key Responsibilities

Design and lead the development of the Stream Processing & Data Platform, enabling ingestion, transformation, and storage of high-frequency time-series and event data.

Define and maintain data architecture standards, including schema design, data lifecycle, and retention strategies.

Architect Kafka-based data pipelines for telemetry, alarms, and operational events, supporting both real-time and near real-time workloads.

Evaluate and integrate time-series databases (e.g., InfluxDB, TimescaleDB, OSI PI) for telemetry data storage and analytics.

Design and implement RESTful APIs and WebSocket interfaces for applications to access time-series and event data.

Lead development using .NET/ Rust  for data processing

Qualifications

Bachelor’s or master’s degree in computer science, Software Engineering, Data Engineering, or a related field.

Deep expertise in Apache Kafka, Kafka Streams, MQTT and connector ecosystems.

Experience in microservices frameworks and programming in .Net Core and deployment in containerized environment.

Strong hands-on experience with Influx DB, Timescale DB, or OSI PI for telemetry and time-series data.

Proficiency in building and maintaining REST APIs, GraphQL, or WebSocket-based services.

Skills & Requirements

Stream Processing, Data Platform Architecture, High-Frequency Time-Series Data, Event-Driven Architecture, Data Ingestion, Data Transformation, Data Storage, Data Architecture Standards, Schema Design, Data Lifecycle Management, Data Retention Strategies, Apache Kafka, Kafka Streams, MQTT, Kafka Connect, Real-Time Data Processing, Near Real-Time Processing, Time-Series Databases, InfluxDB, TimescaleDB, OSI PI, Telemetry Data Management, RESTful APIs, WebSocket, GraphQL, Microservices Architecture, .NET Core, Rust, Containerization, API Development

Apply Now

Join Our Community

Let us know the skills you need and we'll find the best talent for you