GCP Data Engineer

Role: GCP Data Engineer Experience: 5+ Years Location: Gurgaon Work Mode: Hybrid [3 Days Office] POSITION SUMMARY We are seeking a highly skilled GCP Data Engineer to design, develop, and maintain scalable data platforms and pipelines on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in big data technologies, data warehousing, ETL/ELT development, cloud infrastructure, and modern DevOps practices. The role requires close collaboration with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions that drive business insights and decision-making. ROLES AND RESPONSIBILITIES: • Design, build, and optimize scalable data pipelines and data processing frameworks on GCP. • Develop and maintain ETL/ELT workflows for ingesting, transforming, and delivering data across multiple systems. • Create and manage enterprise-scale data warehouses and data marts. • Design efficient and scalable data models for both OLTP and OLAP use cases. • Develop batch and real-time data processing solutions. • Ensure data quality, governance, reliability, and performance across data platforms. • Collaborate with cross-functional teams to gather requirements and implement data driven solutions. • Implement monitoring, logging, and performance optimization for production data workflows. • Support CI/CD implementation and DevOps best practices for data engineering projects. • Stay current with emerging GCP services and industry trends to continuously improve the data ecosystem. REQUIRED QUALIFICATIONS 1. Core Data Engineering Skills • Big Data Technologies: Proficiency in using GCP's big data tools like: • BigQuery: For data warehousing and SQL analytics. • Dataproc: For running Spark and Hadoop clusters. • Airflow: For pipeline Orchestration • Dataflow: For stream and batch data processing. (High level Idea) • Pub/Sub: For real-time messaging and event ingestion. (High level Idea) • Data Modeling: Experience/Knowledge on designing scalable, efficient data models for OLAP and OLTP use cases. • ETL/ELT Pipelines: • Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Fusion. EXL Service 2. Programming and Scripting • Strong coding skills in Python, SQL, and optionally Java/Scala. • Familiarity with APIs and SDKs for GCP services to build custom data solutions. 3. Cloud Infrastructure • Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions. • Familiarity with Kubernetes (GKE) and containerisation for deploying data pipelines. (Optional but Good to have) 4. DevOps and CI/CD • Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or other tools. • Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows. EDUCATION: Bachelor’s degree in computer science, Software Engineering, MIS or equivalent combination of education and experience KEY SKILLS: Python, SQL, GCP Cloud, SQL EXL Service