Data Engineer (AWS)
Job Summary:
The Data Engineer (AWS) plays a critical role in transforming raw data into
valuable insights. This position is vital for developing and maintaining
robust data pipelines that support effective decision-making across the
organization.
Key Responsibilities:
-
Design and implement scalable data pipelines using AWS services such as
Glue, Lambda, and Step Functions.
-
Develop and optimize SQL queries for data processing and extraction to meet
analytical needs.
-
Collaborate with data scientists and analysts to understand data
requirements and provide efficient data access.
-
Maintain and enhance data storage solutions in AWS environments,
particularly with Redshift and S3.
-
Deploy and manage data workflows in a hybrid environment, ensuring high
availability and performance.
-
Monitor and troubleshoot data pipeline performance issues, implementing
solutions for continuous improvement.
-
Document processes and create data flow diagrams to ensure clarity in data
management practices.
Requirements:
- 4-6 years of experience in data engineering or a related field.
- Proficient in SQL for data manipulation and querying.
-
Strong programming skills in Python or PySpark for data processing tasks.
-
Hands-on experience with AWS services: S3, Glue, Lambda, Redshift, Step
Functions, and Athena.
- Familiarity with ETL processes and data modeling concepts.
-
Excellent analytical and problem-solving skills with a strong attention to
detail.
-
Ability to work effectively in a hybrid environment, adapting to changing
priorities.
Preferred Qualifications:
- Experience with data visualization tools such as Tableau or Power BI.
- Knowledge of data governance and security best practices.
- Familiarity with machine learning concepts and frameworks.
- Experience with version control systems, particularly Git.
Benefits:
- Competitive salary and performance bonuses.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work schedules with hybrid work options.
- Opportunities for professional development and continuous learning.
- Employee wellness programs and resources.
- Retirement savings plans with company match.
- Fostering an inclusive and diverse workplace culture.