AWS Data Engg.

AWS Data Engineer

Job Summary:

We are seeking a skilled AWS Data Engineer with 6-8 years of experience to enhance our data infrastructure and manage large data sets. This role will be pivotal in developing and optimizing data pipelines and ensuring seamless integration of data sources within our AWS cloud environment.

Key Responsibilities:

• Design and implement scalable ETL processes using AWS Glue to transform and load data into data lakes.
• Utilize AWS S3 for data storage solutions that support a wide range of analytics workloads.
• Develop Python and PySpark scripts to automate data processing and enrich analytics capabilities.
• Implement and manage AWS Lambda functions for serverless computing tasks within data workflows.
• Leverage Amazon EventBridge to handle real-time data streaming and event-driven architecture.
• Collaborate with data analysts and business stakeholders to understand data requirements and build robust data models.
• Optimize data query performance using Amazon Athena and ensure data governance across all datasets.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 6-8 years of experience in data engineering, specifically within the AWS environment.
• Proficient in Python and PySpark for data manipulation and ETL processes.
• Strong SQL skills with experience in data querying and analytical functions.
• Hands-on experience with AWS services including S3, Glue, Lambda, and Athena.
• Familiarity with data modeling principles and data governance best practices.
• Excellent problem-solving skills and the ability to work collaboratively in a team environment.

Preferred Qualifications:

• Experience with AWS Step Functions for orchestrating complex workflows.
• Knowledge of data warehousing concepts and experience with Amazon Redshift.
• Familiarity with containerization technologies such as Docker and Kubernetes.
• Experience in agile development methodologies and version control systems.
• Certifications in AWS Data Engineering or relevant fields are a plus.