GCP Data Engineer

Job Description – Data Engineer

Role: Data Engineer

Experience: 8+ Years

Location: Open / As per business requirement

Job Summary

We are looking for an experienced Data Engineer with strong expertise in GCP data engineering, Databricks, ETL pipelines, and modern data transformation tools. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines and data processing solutions.

Must-Have Skills

• Strong hands-on experience with GCP data services:
  • BigQuery
  • Dataproc
  • Dataflow
  • Data Composer / Cloud Composer
• Hands-on experience with Databricks.
• Strong knowledge of DBT and/or SAS.
• Strong programming skills in Python and PySpark.
• Advanced SQL skills.
• Strong experience in designing and developing ETL/ELT pipelines.
• Experience in data processing, transformation, integration, and optimization.
• Good understanding of cloud-based data architecture and data engineering best practices.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Composer.
• Build and optimize data pipelines using Databricks, Python, and PySpark.
• Develop complex SQL queries for data transformation and analysis.
• Implement data transformation workflows using DBT and/or SAS.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Work with cross-functional teams to understand data requirements and deliver effective data solutions.
• Ensure data quality, security, and governance across data pipelines.

Required Technical Skills

GCP | BigQuery | Dataproc | Dataflow | Cloud Composer | Databricks | DBT | SAS | Python | PySpark | SQL | ETL | ELT | Data Pipelines