Data Engineer Azure Synapse

Data Engineer (Azure Synapse | ADF | Databricks)

Experience: 5–7 Years
Location: Pune
 

Job Description

We are looking for a hands-on Data Engineer with strong experience in Azure Synapse, Azure Data Factory, PL/SQL, Databricks, Python, Terraform, and CI/CD . The candidate will be responsible for migrating existing on-premise ETL processes to Azure Synapse, developing scalable data pipelines, optimizing data processing, and supporting cloud-based data engineering initiatives.

Key Responsibilities

• Migrate existing ETL processes and database objects from on-premise systems to Azure Synapse .
• Develop complex and optimized Stored Procedures, Functions, and SQL queries .
• Design and maintain automated data pipelines using Azure Data Factory (ADF) .
• Build pipelines to move data from on-premise SQL databases to Azure Synapse.
• Perform query and pipeline performance tuning and resolve bottlenecks.
• Work on PL/SQL, database architecture, and optimization of existing procedures and processes.
• Develop automation using Python , including Pandas and NumPy.
• Work with Azure Functions and Logic Apps for process automation.
• Build complex data transformation processes using Databricks .
• Maintain and enhance migration templates using Terraform .
• Support existing CI/CD pipelines and implement enhancements and feature branches.
• Ensure data quality, reliability, and performance for downstream reporting and analytics.

Required Skills

• Azure Synapse
• Azure Data Factory
• Advanced SQL / PL/SQL
• Database Architecture
• Performance Tuning
• Databricks
• Python
• Pandas / NumPy
• Terraform
• CI/CD
• Git / GitHub