Databricks Solution Architect

Job Title: Databricks Solution Architect

Experience: 12–20 years

Employment Type: Full-Time

---

Role Overview:

We are looking for a seasoned Databricks Solution Architect to lead the design, implementation, and optimization of enterprise-scale data platforms. The ideal candidate will have deep expertise in Databricks, Spark, and cloud-native architectures across multiple cloud providers. This role involves translating business needs into scalable, high-performance data solutions, integrating AI/ML capabilities, and driving cloud transformation initiatives.

---

Key Responsibilities:

• Architect and implement enterprise data solutions on Databricks supporting real-time and batch analytics.

• Lead end-to-end design of cloud-based data platforms on AWS, Azure, or GCP, ensuring scalability, security, and cost efficiency.

• Collaborate with business stakeholders to translate requirements into data models, pipelines, and platform blueprints .

• Optimize Spark workloads, ETL/ELT pipelines, and data lakehouse solutions for performance and cost.

• Integrate AI/ML solutions into Databricks pipelines , enabling predictive and prescriptive analytics.

• Ensure data governance, quality, lineage, and compliance standards are implemented across platforms.

• Provide technical leadership, mentor data engineers and architects, and review solution architectures.

• Conduct architecture assessments, POCs, and feasibility studies for emerging technologies in data and analytics.

• Drive best practices and standards for cloud-based big data, streaming, and AI/ML solutions.

---

Required Skills & Experience:

• 12–20 years of overall experience in data architecture, cloud, and big data engineering.

• 5+ years hands-on Databricks experience , including PySpark, Spark Streaming, and Delta Lake.

• Databricks certifications : Associate and Professional required.

• Strong expertise in cloud platforms (AWS, Azure, GCP) and multi-cloud deployments.

• Experience designing data lake, data warehouse, and lakehouse architectures .

• Proficient in Kafka, Airflow, Snowflake, Redshift, Synapse, or equivalent .

• Strong data modeling and governance skills using ERwin, Data Vault 2.0, or similar.

• Experience with real-time analytics, ML/AI integration, and high-volume distributed systems .

• Hands-on experience in cost optimization, performance tuning, and scalability planning .

• Excellent leadership, stakeholder management, and cross-functional collaboration skills.

---

Preferred Qualifications:

• TOGAF or equivalent enterprise architecture certification.

• Experience with LangChain, CrewAI, or GenAI integration in data pipelines.

• Exposure to CI/CD, DevOps for data platforms using Jenkins, GitLab CI, or similar.

• Prior experience leading global teams or cross-geography projects .

---

Education:

• B.Tech / B.E / M.Tech in Computer Science, Information Technology, or related field.

---

Soft Skills:

• Strategic thinker with strong problem-solving skills.

• Strong communication, mentoring, and leadership capabilities.

• Ability to influence business and technical stakeholders at senior levels