Job Description: Data Delivery Lead
Role Overview
We are looking for a seasoned Data Delivery Lead to drive the execution of
complex data programs within our modern cloud ecosystem. In this role, you
will orchestrate multiple cross-functional squads building high-value Data
Products on the Microsoft Azure and Databricks platform.
You will act as the bridge between technical engineering teams, product
owners, and business stakeholders. Your primary mission is to ensure the
predictable, high-quality delivery of data solutions while managing a
critical, large-scale migration initiative from legacy systems to our
Lakehouse architecture.
Key Responsibilities
1. Data Program Leadership
-
Orchestrate Delivery:
Lead delivery across multiple agile squads to build and maintain data
products. Ensure dependencies between squads are managed and blockers are
removed swiftly.
-
Agile Governance:
Facilitate Scrum of Scrums, sprint planning, and retrospectives. Standardize
delivery metrics (Velocity, Cycle Time) across squads to predict throughput
accurately.
-
Stakeholder Management:
Translate complex technical progress into clear business value updates for
executive leadership. Manage expectations regarding scope, timeline, and
budget.
2. The Migration Mandate (Crucial)
-
Migration Strategy:
Lead the end-to-end migration of data assets from legacy on-premise to cloud
systems.
-
Cutover Management:
Detailed planning of parallel runs, data parity testing, and "go-live"
cutover strategies to minimize business disruption.
3. Technical Delivery Management (The Stack)
-
Data Quality & Governance:
Enforce policies to ensure all Data Products meet the "Gold" standard of
quality before being served to the business.
-
DevOps Culture:
Champion CI/CD best practices for data pipelines, ensuring automated testing
and deployment using Azure DevOps.
Qualifications & Experience
Must-Have Experience
-
Experience:
8+ years in Project/Program Management, with at least 4 years dedicated to
Data Engineering or Analytics projects.
-
The "Crucial" Skill:
Proven track record leading large-scale Data Migrations. You must be able to
articulate how you handled data reconciliation and cutovers.
-
Tech Stack Fluency:
Deep familiarity with the Azure Data Stack and Databricks (PySpark, Delta
Lake, Notebooks). You do not need to code, but you must understand the
architecture well enough to challenge estimates.
-
Squad Management:
Experience working in a matrixed environment managing delivery across
multiple autonomous teams.
Core Competencies
-
Strong understanding of Data Lifecycle Management (Ingestion ->
Transformation -> Serving).
- Mastery of Agile tools (Jira, Azure DevOps).
```