Azure Data Engineer

Job Summary 
We are looking for a skilled and motivated  Azure Data Engineer  to design, develop, and maintain scalable cloud-based data solutions on Microsoft Azure. The ideal candidate should have strong expertise in  Azure Databricks, Azure Data Factory, ADLS Gen2, PySpark, Python, SQL, ETL pipelines , and experience working with modern data engineering and analytics platforms. Exposure to  Azure Function Apps, Logic Apps, and Machine Learning workflows  is highly preferred. 

Experience: 5-10 Years

Key Responsibilities 
 

• Design, build, and optimize scalable data pipelines using  Azure Data Factory (ADF)  and  Azure Databricks . 
   
• Develop and maintain ETL/ELT processes for structured and unstructured data. 
   
• Work with  Azure Data Lake Storage Gen2 (ADLS2)  for enterprise-scale data storage solutions. 
   
• Implement data transformation and processing using  PySpark  and  Python . 
   
• Develop reusable and efficient code for large-scale data processing. 
   
• Integrate various data sources and APIs using  Azure Function Apps  and  Logic Apps . 
   
• Write complex SQL queries, stored procedures, and performance optimization scripts. 
   
• Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions. 
   
• Support deployment, monitoring, troubleshooting, and optimization of Azure-based data platforms. 
   
• Participate in data modeling, data governance, and data quality initiatives. 
   
• Work on Machine Learning data preparation and feature engineering workflows. 
   
• Ensure security, scalability, reliability, and performance of data solutions. 
   

Required Skills 
 

• Strong hands-on experience with: 
   
• Azure Databricks 
   
• Azure Data Factory (ADF) 
   
• Azure Data Lake Storage Gen2 (ADLS2) 
   
• Python 
   
• PySpark 
   
• SQL 
   
• ETL/ELT Development 
   
• Microsoft Azure Cloud Services 
   
• Experience with: 
   
• Azure Function Apps 
   
• Azure Logic Apps 
   
• Data integration and orchestration 
   
• Performance tuning and optimization 
   
• Good understanding of: 
   
• Data warehousing concepts 
   
• Big Data processing 
   
• CI/CD and DevOps practices 
   
• Cloud security and access management 
   

Preferred Skills 
 

• Experience with  Machine Learning (ML)  workflows and data preparation. 
   
• Knowledge of  Delta Lake , Spark optimization, and streaming concepts. 
   
• Familiarity with Git, Azure DevOps, and Agile methodologies. 
   
• Exposure to Power BI or other visualization tools is a plus.