Data lead with AI

Senior Technical Lead - Data Platforms

---

Job Overview

We are looking for a senior technical lead to design, scale, and govern enterprise-grade data platforms across Microsoft Fabric, Databricks, and Snowflake. The role focuses on defining data architecture standards, enabling AI/GenAI-ready platforms, leading engineering teams, and delivering secure, high-performance cloud data solutions that support analytics and business outcomes.

---

Key Responsibilities

• Lead the design and implementation of scalable data platforms using Microsoft Fabric, Databricks and Snowflake including:
  • Pipelines
  • Notebooks
  • Lakehouse
  • Data Warehouse
  • Semantic Models
• Define end-to-end data architecture standards, patterns, and best practices across ingestion, storage, transformation, modeling, and consumption layers.
• Guide technical decisions on compute patterns, storage optimization, pipeline orchestration, and data modeling frameworks.
• Evaluate and integrate emerging technologies to modernize the platform and enable AI/GenAI workloads.
• Partner with AI/ML teams to productionize models and integrate them with enterprise data workflows.
• Ensure data governance, lineage tracking, and metadata standards to support trustworthy AI initiatives.
• Champion data governance, security, privacy, and compliance requirements within the platform.
• Implement observability frameworks for pipeline monitoring, performance tuning, and reliability engineering.
• Drive continuous improvement initiatives to enhance platform robustness and engineering productivity.
• Work closely with product owners, business stakeholders, architects, and analytics teams to translate requirements into scalable technical solutions.
• Serve as the primary technical point of contact for data platform projects and stakeholders.
• Communicate technical roadmaps, project risks, and delivery plans clearly and effectively.
• Develop and deliver dashboards and reports using Power BI and Tableau.

---

Key Skills

• Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or equivalent professional experience.
• Experience: 12+ years of experience in data engineering, data platform development, or cloud data architecture.
• Leadership: 3+ years in a technical leadership or team management role.
• Expertise: Mandatory deep hands-on expertise with Microsoft Fabric, Snowflake or Databricks:
  • Pipelines
  • Notebooks
  • Lakehouse
  • Data Warehouse
  • Semantic Models
• Strong proficiency in PySpark, distributed compute, and data transformation frameworks.
• Advanced SQL capabilities and experience building stored procedures for transactional and analytical workloads.
• Proven track record in designing and delivering large-scale data platforms in cloud environments (Azure preferred).
• Solid understanding of AI/ML data workflows, GenAI dataset preparation, and integration patterns.
• Demonstrated ability to lead engineering teams, drive architectural decisions, and oversee complex technology implementations.
• Strong communication, stakeholder management, and technical documentation skills.
• Proficiency in creating interactive dashboards and reports using Power BI and Tableau.