Senior Data Engineer [AWS]
Job Summary:
We are seeking an experienced Senior Data Engineer to join our dynamic team.
In this pivotal role, you will harness your extensive expertise in SQL,
Python, and AWS services to design and implement robust data solutions,
driving business intelligence and analytics across the organization.
Key Responsibilities:
-
Develop and optimize ETL processes using AWS Glue and Spark to ensure timely
and accurate data ingestion.
-
Design and maintain scalable data pipelines leveraging AWS services such as
S3, Redshift, and Athena.
-
Implement data governance frameworks, ensuring data quality and compliance
within cloud architectures.
-
Collaborate with data scientists and analysts to understand data needs and
deliver data solutions that enable actionable insights.
-
Utilize AWS Lambda, EventBridge, and SQS to create event-driven
architectures for real-time data processing.
-
Monitor and troubleshoot data flows using AWS CloudWatch and CloudTrail to
ensure reliability and performance.
-
Document data engineering processes, architectures, and best practices to
facilitate knowledge sharing across the team.
Requirements:
-
Bachelor’s degree in Computer Science, Engineering, or a related field.
- 10+ years of experience in data engineering or a related field.
- Proficient in SQL and Python for data manipulation and analysis.
-
Strong experience with AWS services, including but not limited to S3,
Lambda, Glue, Redshift, and Athena.
-
Solid understanding of data warehousing concepts and data modeling best
practices.
-
Proven ability to work collaboratively in a cross-functional team and manage
stakeholder expectations.
-
Excellent problem-solving skills with a focus on delivering high-quality
data solutions on time.
Preferred Qualifications:
-
Experience with other AWS services, such as Step Functions, EventBridge,
SQS, and SNS.
-
Familiarity with data governance and data security practices in a cloud
environment.
- Knowledge of machine learning principles and frameworks.
-
Relevant AWS certifications, such as AWS Certified Data Analytics or AWS
Certified Solutions Architect.
- Experience with agile methodologies and project management tools.
Benefits:
- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance plans.
-
Flexible working hours and remote work options to support work-life balance.
- Professional development opportunities and access to online courses.
- Retirement savings plan with company matching contributions.
- Generous paid time off policy and holidays.
-
Unique team-building and social events to foster a collaborative culture.