Databricks Solution Architect

Position Title:   Databricks Solution Architect

Experience : 8 +Years

Relevant Databricks Experience: 3–5+ Years

Shift : Monday to Friday (in UK Shift)

Qualification : BTech, BCA, MCA, BE

Role Overview

We are looking for an experienced Databricks Solution Architect to design and lead enterprise-scale Data Lakehouse, Data Engineering, Analytics and AI solutions using the Databricks platform.

The ideal candidate should have strong hands-on experience with Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog and cloud platforms such as Azure/AWS, along with excellent solution architecture and stakeholder-management skills.

Key Responsibilities

• Design end-to-end Databricks Lakehouse architectures for enterprise data platforms.
• Translate business and technical requirements into scalable, secure and cost-effective solutions.
• Design batch, streaming and near-real-time data pipelines.
• Define architecture using Bronze/Silver/Gold Medallion Architecture.
• Design solutions using Delta Lake, Unity Catalog, Databricks SQL, Workflows and DLT/Lakeflow.
• Lead data platform modernization and migration initiatives.
• Optimize Spark/PySpark workloads, clusters, queries and data pipelines for performance and cost.
• Define data governance, security, access control, lineage and compliance frameworks.
• Work with cloud services across Azure / AWS / GCP.
• Establish CI/CD and Infrastructure-as-Code practices using Git, Terraform, Azure DevOps/GitHub Actions.
• Collaborate with Data Engineers, Data Scientists, DevOps teams and Enterprise Architects.
• Conduct architecture workshops, technical discussions, POCs and solution presentations.
• Prepare HLD/LLD, architecture diagrams, migration roadmaps and technical proposals.
• Mentor engineering teams and establish Databricks best practices.
• Support technical presales, RFP/RFI responses and client-facing solutioning where required.

Mandatory Skills

• Databricks
• Databricks Lakehouse Architecture
• Apache Spark / PySpark
• Delta Lake
• Unity Catalog
• Databricks Workflows / Jobs
• Databricks SQL
• Delta Live Tables / Lakeflow
• Python and SQL
• Strong ETL/ELT and data engineering experience
• Batch & streaming data processing
• Data modeling and Medallion Architecture
• Strong experience in at least one cloud: Azure / AWS / GCP
• Spark performance tuning and optimization
• Data governance and security
• Architecture/design and stakeholder management

Good to have skills

• Terraform / Infrastructure as Code
• Azure Data Factory / Airflow
• Kafka / Event Hubs
• MLflow / MLOps
• Databricks Asset Bundles
• CI/CD
• Snowflake / Synapse
• dbt
• Data migration / modernization
• GenAI / RAG / Vector Search / Mosaic AI
• Databricks certification
• AWS/Azure certification

Certification Preferred:

• Databricks Certified Data Engineer Professional
• Databricks Certified Solutions Architect / relevant Databricks certification
• Azure/AWS/GCP certification