AWS Lead Data Engineer

AWS Lead Data Engineer

Job Summary:

The AWS Lead Data Engineer will play a critical role in our data engineering team, focusing on designing and implementing scalable data solutions on AWS. The successful candidate will leverage advanced technologies like Snowflake and Pyspark to drive impactful analytics, ensuring data integrity and accessibility within the organization.

Key Responsibilities:

• Design and architect robust data pipelines on AWS to facilitate data ingestion, transformation, and storage.
• Lead a team of data engineers, providing guidance and support to ensure project milestones are met.
• Implement and optimize data processing workflows using Snowflake and Pyspark for real-time analytics.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Ensure data security, quality, and governance while maintaining compliance with industry standards.
• Perform regular performance tuning and system optimization to enhance data handling capabilities.
• Mentor junior engineers and promote best practices within the team to foster a culture of continuous improvement.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 8+ years of experience in data engineering, with a focus on AWS technologies.
• Proficiency in Snowflake and Pyspark for efficient data processing and analytics.
• Demonstrated experience in leading teams and managing projects successfully.
• Strong understanding of data warehousing concepts and cloud architectures.
• Excellent problem-solving skills and ability to work under tight deadlines.
• Strong interpersonal skills with a collaborative mindset and a focus on teamwork.

Preferred Qualifications:

• Experience with additional AWS services such as Redshift, DynamoDB, or EMR.
• Familiarity with machine learning frameworks and their implementation.
• Knowledge of data visualization tools such as Tableau or Power BI.
• Certifications in AWS (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect) are a plus.