We are looking for a highly skilled Senior Data Engineer with strong expertise in Google
Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate
will be responsible for designing, building, and optimizing scalable data pipelines and
cloud-based data processing solutions for enterprise applications.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using GCP services.
• Build and maintain real-time and batch data processing pipelines using Dataflow and
Apache Beam.
• Develop robust backend processing solutions using Java.
• Work extensively with BigQuery for data warehousing, analytics, and performance
optimization.
• Integrate data from multiple sources including APIs, databases, and streaming
platforms.
• Optimize pipeline performance, cost, scalability, and reliability on GCP.
• Collaborate with cross-functional teams including Architects, Analysts, DevOps, and
Business stakeholders.
• Ensure data quality, governance, monitoring, and security best practices.
• Troubleshoot production issues and provide long-term scalable solutions.
Required Skills
• Strong hands-on experience with GCP services.
• Expertise in Google Dataflow / Apache Beam.
• Strong programming skills in Java.
7+Years
Chennai / Bangalore / Coimbatore (Hybrid)
Lead Data Engineer – GCP | Dataflow | Java | BigQuery
• Hands-on experience with BigQuery.
• Experience in building batch and streaming data pipelines.
• Good knowledge of SQL and data modeling concepts.
• Experience with CI/CD, Git, and Agile methodologies.
• Strong problem-solving and debugging skills.
Google Dataflow
Apache Beam.
Java
BigQuery
data pipelines.
SQL
data modeling concepts
CI/CD
Git
Agile methodologies