AWS DATA ENGINEER ROLE

AWS Data Engineer

Location: Pune – Shivaji Nagar
Work Mode: Hybrid – 3 Days Office
Experience: 9+ Years

Job Overview

We are looking for an experienced AWS Data Engineer with strong hands-on expertise in AWS, EMR, Python, PySpark, SQL, Airflow, and Databricks . The ideal candidate should have strong experience in building scalable data pipelines, distributed data processing, and modern data engineering solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using AWS, Databricks, Python, and PySpark.
• Build and optimize distributed data processing solutions using Apache Spark .
• Work with AWS EMR for large-scale data processing.
• Develop complex SQL queries , analytical queries, nested queries, and perform query optimization.
• Build and orchestrate data pipelines using Apache Airflow / MWAA .
• Work with Databricks, Delta Lake, Delta Tables, Unity Catalog, DLT, and Delta Sharing .
• Implement incremental data processing and optimize Spark workloads.
• Work with AWS services such as S3, EC2, and ADX .
• Design data models for structured and unstructured datasets.
• Work with databases and query services including Redshift, RDS, Athena, and Redshift Spectrum .
• Troubleshoot performance and data pipeline issues and ensure data quality.
• Take ownership of complex projects and deliver solutions independently.
• Stay updated with emerging data engineering technologies and best practices.

Mandatory Skills

• AWS
• AWS EMR
• Python
• PySpark
• SQL
• Apache Airflow / MWAA
• Databricks
• Apache Spark
• Delta Lake / Delta Tables
• Unity Catalog

Required Experience

• 5+ years of experience building scalable and robust data engineering solutions .
• 4+ years of experience with Apache Spark and distributed computing.
• 3+ years of hands-on experience with Databricks .
• 4+ years of experience building scalable ETL/ELT pipelines on Databricks and AWS EMR.
• 2+ years of experience with Airflow / MWAA .
• Strong Python and PySpark programming skills with understanding of OOP and TDD.
• Strong experience in SQL coding and query optimization .
• 3+ years of experience with data modeling for structured and unstructured datasets.

Good to Have

• Experience with Delta Live Tables (DLT) and Delta Sharing.
• Experience with Redshift, RDS, Athena, and Redshift Spectrum .
• Healthcare domain experience.
• Bachelor's degree in Computer Science, Software Engineering, or a related discipline.

Ideal Candidate

The candidate should demonstrate strong analytical and problem-solving skills, ownership, accountability, and the ability to independently contribute to complex projects .

Work Location: Shivaji Nagar, Pune
Work Mode: Hybrid – 3 Days Work From Office
Experience: 9+ Years