About the role

Azure Data Engineer

Job Summary:

We are seeking a skilled Azure Data Engineer to join our dynamic team and contribute to our data integration and analytics initiatives. In this role, you will harness your expertise in Azure technologies to design and implement robust data solutions that drive business insights and improvements.

Key Responsibilities:

Design and implement data pipelines leveraging Azure Synapse, Data Bricks, and Python to facilitate data integration and processing.
Develop and optimize SQL queries for performance, ensuring the efficiency of data retrieval and transformation processes.
Collaborate with cross-functional teams to gather requirements and ensure the solutions align with business objectives and data strategy.
Utilize PySpark to process large datasets, implementing data quality checks and transformations as needed.
Monitor and troubleshoot data pipelines, ensuring reliability and integrity of data flows across the Azure environment.
Document technical designs, data models, and pipeline architectures to promote knowledge sharing and best practices.
Stay updated with the latest Azure technologies and industry trends to continuously enhance data engineering capabilities.

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer, specifically with Azure services such as Azure Synapse, Data Bricks, and Azure SQL Database.
Strong proficiency in Python and experience with PySpark for data processing and manipulation.
Solid understanding of data warehousing concepts and data modeling techniques.
Experience in SQL for writing complex queries and data analysis.
Excellent analytical and problem-solving skills with attention to detail.
Ability to work collaboratively in a team environment and communicate effectively with stakeholders.

Preferred Qualifications:

Experience with Azure Data Factory for orchestrating data pipelines.
Familiarity with machine learning concepts and their application in data engineering.
Knowledge of data governance and data security best practices.
Exposure to Agile methodologies and experience working in Agile teams.
Certifications in Azure Data Engineering or related fields are a plus.