About the role

Job Title: Senior Data Engineer / Databricks Engineer

Company: EXL
Experience: 4–15 Years
Location: All EXL Locations (Hybrid)
Employment Type: Full-Time

About EXL

EXL is a leading global data analytics and digital operations company that partners with organizations across banking, insurance, healthcare, retail, and other industries to drive business transformation through advanced analytics, AI, cloud, and data engineering. At EXL, you'll work on large-scale cloud data platforms and modern engineering solutions that create measurable business impact.

Job Summary

We are seeking an experienced Databricks Engineer with 6–15 years of experience in Data Engineering to design, develop, and optimize scalable data solutions on the Azure cloud platform. The ideal candidate should possess strong expertise in Azure Databricks, Python, PySpark, SQL, and Azure data services, with hands-on experience building enterprise-grade data pipelines and modern data lake architectures.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks.
Develop efficient ETL/ELT workflows using Python, PySpark, and SQL.
Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.
Implement scalable data solutions on Azure Cloud following industry best practices.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Work with Delta Lake and modern lakehouse architectures.
Ensure data quality, reliability, governance, and security across data platforms.
Collaborate with architects, business stakeholders, analysts, and cross-functional engineering teams.
Perform code reviews and follow CI/CD and DevOps best practices.
Troubleshoot production issues and continuously improve existing data pipelines.

Required Skills

Strong experience in Azure Databricks
Excellent programming skills in Python
Strong hands-on experience with PySpark
Advanced knowledge of SQL
Experience with Microsoft Azure cloud platform
Expertise in ETL/ELT development and data pipeline design
Strong understanding of Spark optimization and performance tuning
Experience with Delta Lake and Lakehouse architecture
Knowledge of Git and CI/CD practices
Excellent analytical and problem-solving skills

Preferred Skills

Experience with Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS Gen2)
Azure Synapse Analytics
Snowflake
Azure DevOps
Streaming technologies such as Kafka or Event Hubs
Databricks Workflows and Unity Catalog
Experience working in Agile/Scrum environments

Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
4–15 years of experience in Data Engineering.
Hands-on experience delivering enterprise-scale cloud data solutions.

Why Join EXL?

Work on cutting-edge Azure and Databricks projects.
Exposure to global clients across multiple industries.
Collaborative engineering culture with opportunities for innovation.
Continuous learning and certification support.
Career growth in cloud, big data, AI, and analytics.