About the role

Senior Data Engineer

Job Summary:

We are seeking an experienced Senior Data Engineer to join our dynamic team, specializing in data architecture and engineering solutions. In this pivotal role, you'll leverage your expertise in SQL, Python, and AWS technologies to drive data integration and transformation efforts that empower our organization to make data-driven decisions.

Key Responsibilities:

Design and implement scalable data pipelines using AWS services such as Glue, Lambda, and Step Functions.
Develop and maintain complex SQL queries and Python scripts to extract, transform, and load (ETL) data from various sources.
Lead a team of data engineers, providing mentorship and guidance to ensure the successful delivery of data solutions.
Monitor and optimize data workflows and storage solutions in AWS, using services like Redshift, Athena, and S3.
Collaborate with data analysts, data scientists, and stakeholders to understand data requirements and design appropriate solutions.
Implement data governance best practices to ensure data quality, security, and compliance across the organization.
Utilize AWS CloudWatch for monitoring and troubleshooting data processes, ensuring high availability and performance of data services.

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field.
5+ years of experience in data engineering roles, with a strong focus on SQL and Python or PySpark.
Extensive experience with AWS data services, including S3, Lambda, Glue, Redshift, Athena, and related tools.
Proven experience in designing and implementing ETL processes and data pipelines on cloud infrastructure.
Strong problem-solving skills and the ability to work collaboratively within a team-oriented environment.
Familiarity with event-driven architecture, using tools like SQS, SNS, and EventBridge.
Excellent communication skills, capable of translating complex technical concepts to non-technical stakeholders.

Preferred Qualifications:

Master’s degree in a relevant field such as Data Science or Business Analytics.
Experience leading a team of data engineers or developers in a fast-paced environment.
Knowledge of data visualization tools such as Tableau or Power BI.
Hands-on experience with data modeling and database design principles.
Familiarity with Agile methodologies and tools like JIRA for project management.