Data Engineer
Job Summary:
The Data Engineer will play a critical role in building and optimizing our data pipelines and ETL processes, ensuring seamless data management and accessibility across the organization. This position is essential for transforming raw data into actionable insights that drive data-driven decision-making, enabling our teams to leverage vast amounts of information effectively.
Key Responsibilities:
- Design and implement robust ETL processes to extract, transform, and load data from various sources into Snowflake.
- Develop and maintain SQL queries and scripts to facilitate data analysis and reporting for stakeholders.
- Optimize existing data pipelines to ensure stability, performance, and scalability within AWS environments.
- Collaborate with data scientists and analysts to understand data requirements and provide necessary solutions.
- Monitor and troubleshoot data issues, ensuring data integrity and accuracy throughout the data lifecycle.
- Assist in migrating data and applications to cloud-based platforms, focusing on AWS architecture.
- Document data workflows, processes, and developments to ensure knowledge transfer and maintain best practices.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience in data engineering, with strong proficiency in SQL for data manipulation and analysis.
- Hands-on experience with ETL tools and methodologies, particularly regarding Snowflake.
- Strong programming skills in Python or PySpark for data transformation tasks.
- Familiarity with AWS services (e.g., S3, Lambda, Glue) in a data engineering context.
- Ability to work collaboratively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Strong analytical and problem-solving skills, with attention to detail and data quality assurance.