Azure Data Engineer
Job Summary:
We are seeking an experienced Azure Data Engineer to join our innovative team
at EXL in Pune. This role is crucial in leveraging data on the Azure cloud
platform to drive strategic insights and improve business solutions,
contributing significantly to our mission of data excellence.
Key Responsibilities:
-
Design and implement robust data pipelines using Azure Data Factory,
ensuring efficient data flow and optimization.
-
Develop and maintain ETL processes leveraging PySpark and Azure Databricks
for large data sets.
-
Collaborate with cross-functional teams to understand data requirements and
translate them into technical specifications.
-
Optimize SQL queries and databases to enhance data retrieval and storage
performance.
-
Utilize Azure Synapse to architect data frameworks and facilitate complex
data analysis.
-
Monitor and troubleshoot data workflows, ensuring high availability and
reliability of data processes.
-
Document data engineering processes and maintain best practices for data
management.
Requirements:
-
Minimum of 8-10 years of experience in data engineering, with a strong focus
on Azure technologies.
- Proficient in Python and PySpark for data manipulation and analysis.
-
Extensive knowledge of Azure cloud services, specifically Azure Data Factory
and Azure Synapse Analytics.
- Strong SQL skills for data querying and database management.
-
Demonstrated experience with data modeling and transforming diverse data
sources.
-
Ability to work collaboratively in a team setting and effectively
communicate technical concepts.
-
Bachelor's degree in Computer Science, Information Technology, or a related
field.
Preferred Qualifications:
- Experience with data visualization tools such as Power BI or Tableau.
- Knowledge of data governance and best practices in data security.
- Prior experience with machine learning frameworks and libraries.
-
Certifications in Azure Data Engineering or related fields are a plus.
Benefits:
- Competitive salary package with performance-based bonuses.
- Comprehensive health insurance and wellness programs.
- Opportunities for continuous learning and professional development.
-
Flexible working hours with a work-from-office model, enhancing team
collaboration.
- Dynamic and inclusive work environment with a focus on innovation.
- Access to the latest tools and technologies to succeed in your role.
- Regular team-building activities and company-sponsored events.