Data Engineering Lead
Job Summary:
The Data Engineering Lead will spearhead our data transformation initiatives, utilizing tools like Azure Data Factory, Python, and Snowflake to deliver impactful data solutions. This role combines technical proficiency with team leadership and client-facing responsibilities, ensuring our clients receive exceptional service and innovative data strategies.
Key Responsibilities:
- Lead the data engineering team in designing and implementing robust data pipelines using Azure Data Factory and DBT.
- Develop and optimize ETL processes with SQL and Python to ensure high-quality data integration and accuracy.
- Manage and mentor junior data engineers to enhance their skills and professional growth.
- Collaborate with cross-functional teams to gather requirements and present data-driven solutions to clients.
- Monitor, troubleshoot, and optimize performance of data processes in Snowflake to ensure efficient data storage and access.
- Establish and enforce best practices in data governance and security across all data operations.
- Engage with clients to understand their data needs, providing insights and solutions to enhance their business outcomes.
Requirements:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 8+ years of experience in data engineering, with a strong focus on Azure Data Factory, Snowflake, and DBT.
- Proficiency in SQL and Python for data manipulation and analysis.
- Demonstrated experience leading teams and managing projects in a fast-paced environment.
- Strong client-facing skills with a proven ability to communicate technical concepts to non-technical stakeholders.
- Experience with data modeling, data warehousing concepts, and ETL processes.
- Knowledge of data protection regulations and best practices in data management.
Preferred Qualifications:
- Master's degree in a relevant field.
- Familiarity with cloud technologies and services, particularly within the Azure ecosystem.
- Experience in implementing machine learning models in a cloud environment.
- Certifications in Azure Data Engineering or Snowflake would be a plus.