AWS Snowflake Data Engineer
Job Summary:
The AWS Snowflake Data Engineer will play a pivotal role in designing and
implementing data pipelines that leverage AWS and Snowflake to support our
data-driven decision-making. By integrating data from diverse sources and
ensuring data integrity, you'll contribute to the scalability and performance
of our analytics platform, driving insights that fuel business growth.
Key Responsibilities:
-
Design and develop efficient data pipelines using AWS services like Glue,
Lambda, and S3 to facilitate data ingestion and processing.
-
Implement robust ETL processes to transform and load data into Snowflake,
ensuring high performance and scalability.
-
Collaborate with data scientists and analysts to understand data
requirements and deliver relevant data solutions.
-
Monitor and optimize existing data workflows to improve efficiency and
reduce processing times.
-
Automate data validation and cleansing processes to ensure data accuracy and
integrity.
-
Utilize PySpark to perform large-scale data processing and transformation
tasks as required.
-
Document data architecture and processes to facilitate knowledge sharing and
compliance.
Requirements:
-
Bachelor’s degree in Computer Science, Information Technology, or a related
field.
-
Proven experience working with AWS services, particularly concerning data
storage and processing.
-
Hands-on experience with Snowflake, including data modeling and query
optimization.
-
Strong proficiency in Python and PySpark for data processing and
transformation.
-
Understanding of database technologies, data warehousing concepts, and data
governance practices.
- Excellent problem-solving skills with a keen attention to detail.
-
Strong communication skills to facilitate collaboration within
cross-functional teams.
Preferred Qualifications:
-
Experience with data visualization tools such as Tableau, Looker, or Power
BI.
- Familiarity with CI/CD pipelines for data engineering workflows.
-
Knowledge of additional cloud platforms (Azure, Google Cloud) is a plus.
-
Experience in machine learning or big data frameworks would be advantageous.