About the role

Data Engineer

Job Summary:

As a Data Engineer, you will play a critical role in designing and implementing robust data pipelines and architectures that enable our organization to harness data effectively. You will collaborate with cross-functional teams to ensure the integrity and accessibility of data, driving data-driven decision-making throughout the company.

Key Responsibilities:

Design and develop scalable data pipelines using Python, PySpark, and SQL to process large sets of data efficiently.
Construct and maintain data models in Azure Synapse and Databricks, ensuring optimal performance and data integrity.
Integrate data from a variety of sources into centralized data platforms, enhancing data accessibility for stakeholders.
Monitor data quality and troubleshoot issues, implementing solutions to optimize data processing workflows.
Collaborate with data scientists and analysts to understand data requirements and provide necessary datasets.
Document and maintain best practices for data engineering processes and workflows.
Stay updated with industry trends and emerging technologies in data engineering to continually improve the team's capabilities.

Requirements:

Bachelor's degree in Computer Science, Information Technology, or a related field.
4-8 years of relevant experience in data engineering or a similar role.
Proficiency in programming languages, specifically Python and SQL.
Hands-on experience with Apache Spark (PySpark) for big data processing.
Solid experience with cloud platforms, particularly Azure, and services like Azure Synapse and Databricks.
Strong understanding of data warehousing concepts and ETL processes.
Excellent problem-solving skills and the ability to work independently in a hybrid work environment.

Preferred Qualifications:

Experience working with machine learning frameworks and data modeling techniques.
Familiarity with other big data technologies such as Apache Hadoop or Kafka.
Knowledge of data governance and data quality best practices.
Strong communication skills, with the ability to convey complex data concepts to non-technical stakeholders.
Certifications in Azure or relevant data engineering frameworks are a plus.

Benefits:

Competitive salary with performance-based bonuses.
Comprehensive health, dental, and vision insurance packages.
Flexible hybrid work schedule promoting work-life balance.
Opportunities for continuous learning and professional development.
Generous paid time off and holidays to rejuvenate and recharge.
Collaborative and inclusive work environment with a focus on team success.
Access to the latest technologies and tools in data engineering.

Data Enginner