Azure Data Engineer

Data Engineer

Job Summary:

The Data Engineer will be instrumental in driving data initiatives, working with cross-functional teams to design and implement data pipelines and architecture. By leveraging Azure services, Data Factory, Snowflake, DBT, SQL, and Python, you will enable the organization to harness the power of data for informed decision-making and strategic growth.

Key Responsibilities:

• Develop and maintain robust data pipelines using Azure Data Factory to ensure seamless data integration across various sources.
• Design and manage schemas in Snowflake, optimizing for performance and scalability to support analytical workloads.
• Implement data transformation processes using DBT to enhance data quality and preparation for analysis.
• Write and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
• Utilize Python scripting to automate data workflows and improve data processing efficiency.
• Collaborate with data scientists and analysts to understand data requirements and provide timely solutions.
• Monitor and troubleshoot data pipeline performance, ensuring reliability and data integrity across platforms.

Requirements:

• Proven experience in data engineering or a related field, with a strong focus on Azure technologies.
• Expertise in Azure Data Factory for data orchestration and integration.
• Proficient in Snowflake, including data modeling, architecture, and performance tuning.
• Solid experience with DBT for data transformation and management.
• Strong SQL skills for data manipulation and querying from relational databases.
• Proficiency in Python programming for data analysis and automation tasks.
• Excellent communication skills, with the ability to work collaboratively in a team-oriented environment.

Preferred Qualifications:

• Experience with cloud-based data warehousing and analytics solutions.
• Familiarity with data governance and security best practices in cloud environments.
• Knowledge of additional programming languages such as R or Scala.
• Understanding of machine learning concepts and frameworks.
• Experience with Agile methodologies and project management tools.

 

```