About the role

As a Lead Data & AI Engineer at Koch Capabilities, you will design, build, and scale enterprise‑grade data platforms that power analytics, AI, and machine learning use cases across the business. This is a hands‑on technical leadership role where you will write production‑quality code, establish engineering standards, and lead delivery across modern, cloud‑native data platforms.

You will play a critical role in shaping data architecture, improving platform reliability, and enabling teams to move faster with trusted, high‑quality data.

Our Team

You will be part of a collaborative data and engineering organization working closely with data engineers, AI/ML practitioners, and analytics teams. Our focus is on building scalable, reliable data foundations and enabling advanced analytics and AI capabilities through strong engineering practices.

What You Will Do

Design and deliver scalable ETL/ELT pipelines and lakehouse architectures supporting analytics and AI workloads.
Lead hands‑on data engineering delivery using cloud‑native AWS services.
Build and maintain CI/CD pipelines to enable automated, reliable, and repeatable deployments.
Partner with AI and ML teams to operationalize data for analytics, model training, and AI use cases.
Establish coding standards, perform code reviews, and mentor engineers through technical leadership.
Optimize performance across Databricks, Apache Spark, and SQL‑based workloads.
Drive data quality, observability, monitoring, and platform reliability across the data ecosystem.

Who You Are (Basic Qualifications)

8–12 years of experience in data engineering with strong, hands‑on technical delivery.
Expert‑level proficiency in Python, PySpark, and SQL.
Deep hands‑on experience with AWS, including services such as S3, Glue, Lambda, Redshift, EMR, and Kinesis.
Strong experience with Databricks, including Delta Lake, Spark optimization, and MLflow.
Experience building and maintaining CI/CD pipelines using tools such as GitHub Actions, Jenkins, or equivalent.
Experience designing and supporting real‑time and streaming data pipelines using technologies such as Kafka or Kinesis.
Strong analytical and problem‑solving approach, with the ability to debug complex issues and build maintainable solutions.

What Will Put You Ahead

Experience with Snowflake, Grafana, or additional cloud data platforms.
Exposure to AI/ML pipeline development, including data preparation and model lifecycle support.
Experience improving platform scalability, performance tuning, and cost optimization in distributed systems.

At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.

Who We Are

At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.

Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.