Lead Data Engineer

Job Description – Lead Data Engineer

---

Position Title:

Lead Data Engineer

Experience:

7–10 Years

Location:

Pune, Bangalore, Noida, Gurgaon, Hyderabad, Chennai

Work Mode:

Hybrid

Job Summary

We are looking for a highly skilled and experienced Lead Data Engineer to design, develop, and optimize scalable cloud-based data platforms and pipelines. The ideal candidate should possess strong expertise in AWS, Snowflake, DBT, Airflow, SQL, and Python, along with proven experience in leading engineering teams and driving end-to-end data transformation initiatives. This role requires a strong understanding of modern data architecture, data warehousing, orchestration frameworks, and best engineering practices to enable reliable and efficient analytics solutions.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines and ETL/ELT workflows using DBT, Airflow, Python, and SQL.
• Build and optimize cloud-native data solutions on AWS and Snowflake platforms.
• Lead data engineering projects and mentor a team of engineers to ensure timely and quality delivery.
• Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand data requirements and deliver solutions.
• Implement data models, data transformation logic, and orchestration workflows for enterprise-scale analytics platforms.
• Ensure data quality, integrity, security, and governance across data systems.
• Optimize query performance, storage strategies, and pipeline efficiency within Snowflake and AWS environments.
• Automate deployment and monitoring processes for data workflows and infrastructure.
• Troubleshoot production issues, perform root cause analysis, and implement preventive measures.
• Establish and enforce best practices for coding standards, CI/CD, testing, documentation, and data engineering processes.
• Participate in architecture discussions and contribute to long-term data platform strategy.

Required Skills & Qualifications

Technical Skills

• Strong hands-on experience with:
• AWS Services (S3, Lambda, Glue, Redshift, EMR, IAM, etc.)
• Snowflake Data Warehouse
• DBT (Data Build Tool)
• Apache Airflow
• Advanced SQL
• Python Programming
• Experience in building and managing large-scale ETL/ELT pipelines.
• Strong understanding of data warehousing concepts, dimensional modeling, and distributed data processing.
• Knowledge of performance tuning, data optimization, and orchestration frameworks.
• Familiarity with version control systems such as Git and CI/CD practices.
• Experience with Agile/Scrum methodologies.

Leadership Skills

• Minimum 2 years of experience leading or mentoring data engineering teams.
• Strong stakeholder management and communication skills.
• Ability to manage multiple priorities and drive project execution independently.

Preferred Qualifications

• Experience working in large enterprise or product-based environments.
• AWS or Snowflake certifications are an added advantage.
• Exposure to real-time data processing and streaming technologies is preferred.
• Knowledge of DevOps and Infrastructure-as-Code practices is a plus.

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.