Data Engineer
Job Summary:
As a Data Engineer, you will play a pivotal role in transforming raw data into
actionable insights for our organization. Your expertise in building and
maintaining robust data pipelines will empower our analytical capabilities and
support key business decisions.
Key Responsibilities:
-
Design and implement scalable ETL/ELT pipelines to ensure efficient data
extraction, transformation, and loading processes.
-
Develop and maintain a comprehensive data architecture using Microsoft
Fabric, Data Lakehouse, and Data Warehouse frameworks.
-
Utilize Azure Data Factory and Azure Synapse for orchestrating data
workflows and real-time analytics solutions.
-
Model complex datasets and create effective data structures to optimize
querying performance.
-
Collaborate with cross-functional teams to integrate data needs and ensure
data integrity across various platforms.
-
Code in Python and PySpark to execute data processing tasks and automate
data workflows.
-
Support API integrations, ensuring seamless data flow and orchestration
across systems.
Requirements:
- B.E./B.Tech/MCA degree in Computer Science or a related field.
-
6-10 years of experience in data engineering with a strong focus on
Microsoft Fabric, Python, and SQL.
-
Expertise in Azure technologies, including Azure Data Factory and Azure
Synapse.
-
Proven experience in building enterprise-level ETL/ELT pipelines and data
modeling.
-
Strong understanding of real-time analytics and data orchestration
methodologies.
-
Excellent problem-solving skills and the ability to work in a fast-paced
environment.
- Willingness to work UK Shift hours (1:00 PM - 10:00 PM IST).
Preferred Qualifications:
- Hands-on experience with Azure Storage and Azure SQL databases.
- Familiarity with Power BI for data visualization and reporting.
- Experience in data governance and data security best practices.
-
Ability to collaborate with stakeholders to define data requirements and
metrics.
Benefits:
- Competitive salary and performance-based bonuses.
- Comprehensive health insurance coverage.
- Flexible work hours with an opportunity for remote work.
- Continual learning and professional development opportunities.
- Supportive work environment that values diversity and inclusion.
- Access to the latest technology and tools to enhance productivity.
- Employee wellness programs and activities.