Lead Data Engineer | 5 Days WFO | Bengaluru

Your Job

We are seeking a Senior Data Engineer to support our GP Team by delivering, stabilizing, and optimizing data engineering solutions across our AWS-based data platform. In this role, you will enhance existing data pipelines, address technical debt, improve performance, and execute high priority backlog items. You will collaborate closely with product owners, analysts, and engineering peers to ensure reliable, scalable, and well documented data solutions that meet evolving business and analytics needs.

Our Team

You will be part of a high impact data engineering team responsible for building and maintaining cloud native data capabilities that power enterprise decision-making. The team partners closely with cross-functional stakeholders, applying principled entrepreneurship to identify opportunities, solve challenges, and continuously create value.

What You Will Do

• Deliver and maintain data engineering backlog items—including enhancements, bug fixes, and refactoring.
• Design, build, and optimize scalable, cost-efficient data pipelines using AWS services (S3, Glue, Lambda, Step Functions, Redshift, Athena, EMR/Spark).
• Troubleshoot and resolve data quality, performance, and reliability issues.
• Refactor legacy data pipelines to improve scalability, maintainability, and operational efficiency.
• Collaborate with product owners and analysts to clarify requirements and define technical solutions.
• Improve observability and monitoring through enhanced logging, alerting, and automated recovery mechanisms.
• Implement data validation, lineage tracking, and governance best practices.
• Support incremental modernization of data architecture on AWS.
• Document data flows, transformations, and operational procedures.
• Contribute to coding standards, best practices, and automation initiatives.

Who You Are (Basic Qualifications)

• Strong experience as a Data Engineer in AWS environments.
• Hands-on expertise with AWS services such as S3, Glue, Lambda, Step Functions, Redshift, Athena, EMR and/or Spark.
• Proficiency in Python and SQL.
• Experience building and maintaining ETL/ELT pipelines.
• Understanding of data modeling concepts (star schema, fact/dimension).
• Experience working in Agile teams and managing technical backlog items.
• Familiarity with data quality, lineage, and governance concepts.
• Ability to leverage AI/automation technologies to accelerate delivery.

What Will Put You Ahead

• Experience with Infrastructure as Code (e.g., Terraform, CloudFormation).
• Exposure to CI/CD pipelines for data engineering.
• Experience working with legacy systems or resolving technical debt.
• Knowledge of AWS cost optimization strategies.

About Koch

At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.

Who We Are

At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company. Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.