Databricks Architect

Key Responsibilities

Solution Architecture & Consulting

·          Lead end-to-end architecture design for Databricks-based Financial Crime and Banking platforms.

·          Define enterprise data architectures leveraging Lakehouse, Delta Lake and Unity Catalog.

·          Conduct discovery workshops with business, compliance, and technology stakeholders.

·          Translate regulatory and operational requirements into scalable technical solutions.

·          Develop target-state architectures, migration roadmaps, and implementation strategies.

Financial Crime & Risk Management

• Architect solutions supporting:

·          AML Transaction Monitoring

·          Customer Risk Assessment (CRA)

·          KYC and Customer Due Diligence

·          Ongoing Due Diligence (ODD)

·          Sanctions and PEP Screening

·          Fraud Detection

·          Financial Crime Investigations

·          Regulatory Reporting

• Design Customer 360 and Financial Crime Lakehouse solutions.
• Enable real-time monitoring and risk analytics using streaming architectures.

Databricks Platform Architecture

• Design enterprise Databricks environments across Azure, AWS, or GCP.
• Architect:

·          Delta Lake

·          Unity Catalog

·          Lakehouse Architecture

·          Lakeflow / DLT

·          MLflow

·          Databricks SQL

·          Auto Loader

·          Vector Search and AI capabilities

• Define security, governance, lineage, and access-control frameworks.
• Ensure scalability, platform resilience, and cost optimization.

Data Engineering Leadership

• Define ingestion frameworks using:

·          CDC

·          Event Streaming

·          Kafka

·          Azure Event Hub

·          Batch Processing

• Design Bronze/Silver/Gold data models.
• Oversee development teams implementing Spark and PySpark pipelines.
• Establish reusable accelerators and architectural standards.

Required Qualifications

Education

• Bachelor's or Master's degree in Computer Science, Engineering, Analytics, Mathematics, or related discipline.

Experience

·          12+ years of Data and Analytics experience.

·          5+ years of hands-on Databricks architecture experience.

·          5+ years within Banking, Financial Services, AML, Fraud, or Financial Crime programs.

·          Proven experience designing enterprise-scale cloud data platforms.

Technical Skills

Databricks

·          Delta Lake

·          Databricks SQL

·          Unity Catalog

·          Lakeflow / DLT

·          MLflow

·          Auto Loader

·          Photon Engine

·          Vector Search

Data Engineering

·          PySpark

·          Python

·          Scala

·          Data Modeling

·          CDC Architecture

·          Batch and Streaming Pipelines

Cloud Platforms

• Azure (preferred)

DevOps & Automation

·          Azure DevOps

·          GitHub

·          CI/CD

·          Terraform

·          Infrastructure as Code

Preferred Certifications

·          Databricks Certified Data Engineer Professional

• Databricks Certified Solution Architect
• Databricks Certified Machine Learning Professional