Senior Data Engineer

Overview

We are looking for a Senior Data Engineer with 7+ years of experience to design, build, and optimize scalable data pipelines within Microsoft Fabric Lakehouse environments. The ideal candidate will have expertise in enterprise data ingestion, ELT processes, Medallion architecture, and high-volume data processing. This role involves implementing robust ingestion and transformation pipelines, optimizing Lakehouse performance, configuring Fivetran connectors, and collaborating with cross-functional teams to deliver reliable and scalable data solutions.

Job Description

Key Responsibilities

Required Qualifications:

  • Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
  • Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
  • Manage large-volume ingestion and backfill operations
  • Implement Bronze to Silver transformation pipelines
  • Develop incremental load and CDC logic
  • Optimize Lakehouse performance and storage patterns
  • Implement monitoring (record counts, load duration, failure tracking)
  • Support Dev/Test/Prod promotion processes

 

  • Required Qualifications
  • 7+ years of data engineering experience
  • Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
  • Strong experience with Fivetran or similar ELT tools
  • Experience handling high-volume datasets (hundreds of millions of records)
  • Proficiency in SQL, Python, and data modeling concepts
  • Strong understanding of Medallion architecture.

Skills & Requirements

Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Data Engineering, Fivetran, ELT, ETL, Lakehouse Architecture, Medallion Architecture, Bronze-Silver-Gold Architecture, SQL, Python, Data Modeling, Change Data Capture (CDC), Incremental Data Loading, Data Ingestion, Data Transformation, Data Pipeline Development, High-Volume Data Processing, Performance Optimization, Data Warehousing, Oracle, SQL Server, Monitoring, Data Backfill, Enterprise Data Integration, Dev/Test/Prod Deployment, Data Pipeline Optimization.

Apply Now

Join Our Community

Let us know the skills you need and we'll find the best talent for you