GCP Data Engineer
Job Summary:
We are seeking an experienced GCP Data Engineer to join our dynamic data team.
In this critical role, you will design and implement robust data pipelines
using Google Cloud Platform technologies, enabling our organization to
leverage data for informed decision-making.
Key Responsibilities:
-
Design and develop scalable ETL processes using Apache Airflow and PySpark
to manage data workflows efficiently.
-
Collaborate with data scientists and analysts to understand data needs and
provide clean, reliable datasets.
-
Implement data governance and security measures to ensure compliance with
industry standards and regulations.
-
Optimize data storage and retrieval strategies within GCP to enhance
performance and minimize cost.
-
Monitor and troubleshoot data pipelines, addressing issues proactively to
maintain data integrity.
-
Document data engineering processes, ensuring clear communication of
workflows and methodologies.
-
Stay up to date with the latest GCP features and best practices,
continuously improving data engineering processes.
Requirements:
-
Bachelor's degree in Computer Science, Engineering, or a related field.
-
5+ years of experience in data engineering, with a strong focus on GCP
technologies.
-
Proficiency in Python and experience with PySpark for large-scale data
processing.
-
Solid understanding of ETL processes and experiences with data pipelines.
-
Experience with SQL and NoSQL databases for data manipulation and retrieval.
-
Strong problem-solving skills with a keen attention to detail.
-
Excellent communication and collaboration abilities to work effectively in a
team setting.
Preferred Qualifications:
-
Experience with Google BigQuery, Dataflow, and Pub/Sub for real-time data
processing.
-
Familiarity with data visualization tools (e.g., Tableau, Looker) to support
data-driven decision-making.
-
Knowledge of machine learning concepts and tools to drive data insights
further.
-
Certifications related to GCP or data engineering will be an advantage.
Benefits:
-
Competitive salary with performance-based bonuses and incentives.
-
Comprehensive health, dental, and vision insurance plans.
-
Ongoing professional development and training opportunities to enhance your
skills.
-
Generous paid time off policy, including holidays and vacation days.
-
Access to the latest tools and technologies in the data engineering field.
-
A vibrant company culture that fosters diversity, creativity, and
innovation.