Sr Data Engineer

Job Description – Senior Databricks AI/BI & Genie Reporting Developer

Position

Senior Databricks AI/BI & Genie Reporting Developer

Experience

• Overall Experience: 8+ years in Reporting, Business Intelligence, Analytics, and Data Engineering
• Relevant Experience: Minimum 1 year of hands-on experience with Databricks AI/BI Dashboards, Genie, and Databricks Lakehouse reporting solutions
• Experience working in enterprise-scale analytics and reporting environments

---

Role Summary

We are looking for an experienced Senior Databricks AI/BI & Genie Reporting Developer to design, develop, and deploy next-generation self-service analytics and conversational BI solutions on the Databricks Lakehouse Platform.

The role will be responsible for building AI-powered reporting solutions using Databricks AI/BI Dashboards , Genie Spaces , Unity Catalog , and Delta Lake data assets. The ideal candidate should possess a strong blend of reporting, analytics, data engineering, and business intelligence expertise.

---

Key Responsibilities

Databricks AI/BI & Genie

• Design and develop interactive dashboards using Databricks AI/BI Dashboards
• Build and configure Databricks Genie Spaces for natural language-based analytics and business user self-service reporting
• Define semantic models and curate datasets for Genie consumption
• Create business-friendly metrics, KPIs, dimensions, and measures
• Configure AI-powered insights, visualizations, and conversational analytics capabilities
• Optimize Genie responses through proper governance and metadata management

Reporting & Analytics

• Translate business requirements into scalable reporting and dashboard solutions
• Develop executive, operational, and regulatory reporting solutions
• Build drill-through and interactive dashboards for business stakeholders
• Support ad-hoc analytics and self-service BI enablement
• Implement reporting best practices including performance tuning and usability optimization

Data Engineering & Lakehouse

• Work with Bronze, Silver, and Gold layer data models within the Databricks Lakehouse architecture
• Develop data transformation pipelines using SQL and PySpark
• Ensure high-quality curated datasets are made available for reporting consumption
• Collaborate with Data Engineers and Architects to optimize reporting data models
• Support Delta Lake implementation, optimization, and performance tuning

Data Governance

• Implement governance standards using Unity Catalog
• Maintain data lineage, metadata, and business glossary definitions
• Ensure compliance with data security and access control requirements
• Support data quality monitoring and reporting validation

Stakeholder Management

• Work closely with Business Users, Product Owners, Data Architects, and Analysts
• Conduct requirement gathering and report walkthrough sessions
• Provide technical guidance on AI/BI and conversational analytics adoption
• Support UAT and production deployment activities

---

Mandatory Technical Skills

Databricks

• Databricks Lakehouse Platform
• Databricks SQL
• Databricks AI/BI Dashboards
• Databricks Genie
• Unity Catalog
• Delta Lake
• Delta Sharing
• Databricks Workflows

Data Engineering

• Python
• PySpark
• SQL
• ETL/ELT Development
• Data Modelling
• Dimensional Modelling

Reporting & BI

• Dashboard Design
• Self-Service Analytics
• KPI Framework Design
• Executive Reporting
• Operational Reporting
• Conversational BI

Cloud Technologies

• Azure Data Services
• Azure Data Lake Storage (ADLS)
• Azure Entra ID (AAD)

---

Preferred Skills

• Power BI
• Azure Data Factory
• Machine Learning fundamentals
• GenAI and LLM-based analytics solutions
• Experience in Insurance, Finance, or Regulatory Reporting domains
• Experience working in Agile/Scrum environments

---

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field
• Databricks certifications are highly preferred
• Strong communication and stakeholder management skills

---

Key Selection Criteria

Criterion	Requirement
Overall Experience	8+ Years
Reporting & BI Experience	5+ Years
Data Engineering Experience	3+ Years
Databricks Experience	2+ Years
Databricks AI/BI & Genie Experience	Minimum 1 Year
SQL	Expert
PySpark	Strong
Stakeholder Interaction	Required
Insurance/Finance Domain	Preferred

Location: India / Mumbai/ Pune/Trivandrum(Hybrid/Remote)
Level: Senior Data & Analytics Consultant / Lead Developer
Project: Enterprise Data Platform / Databricks Lakehouse Reporting & AI Analytics Solutions