Databricks/ETL Developer

ETL Developer / Databricks

Job Summary:

The ETL Developer will play a critical role in designing, developing, and maintaining data integration solutions using Databricks. This position will collaborate with various teams to meet data requirements and enhance overall data quality, directly impacting the efficiency of our data operations.

Key Responsibilities:

• Design, develop, and maintain data integration solutions using Databricks, ensuring scalable and efficient workflows.
• Collaborate with cross-functional teams to understand data requirements and deliver effective data solutions that meet business needs.
• Implement ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.
• Optimize and troubleshoot Databricks workflows and performance issues to enhance system efficiency.
• Ensure data quality and integrity throughout the data lifecycle by implementing robust validation processes.
• Provide technical guidance and mentorship to junior developers, fostering a culture of learning and improvement.
• Stay updated with the latest industry trends and best practices in data integration and Databricks technologies.

Requirements:

• Bachelor’s degree in computer science or a related field.
• Minimum of 3 years of hands-on experience with Databricks (mandatory).
• Strong knowledge of ETL tools such as Informatica, Talend, or SSIS (mandatory).
• Well-versed in data warehousing and data lake concepts.
• Proficient in SQL and Python for data manipulation and analysis.
• Experience with cloud platforms like AWS, Azure, or GCP and their associated data services.
• Excellent problem-solving capabilities, complemented by strong communication and collaboration skills.

Preferred Qualifications:

• Mandatory experience in the Life Sciences.
• Good understanding of healthcare and customer master data processes.
• Strong knowledge of Master Data Management (MDM) entity types like Customer, Organization, Product, Payer, and related healthcare entities.
• Understanding of healthcare data hierarchies, affiliations, and relationship management concepts.
• Good knowledge of GxP compliance concepts and regulated environment processes within the Life Sciences industry.
• Exposure to data governance and data quality practices in regulated pharmaceutical environments preferred.

Benefits:

• Competitive salary with performance-based bonuses.
• Comprehensive health and wellness benefits.
• Flexible work hours and remote work options.
• Generous paid time off and holiday leave.
• Professional development opportunities and training programs.
• Collaborative and inclusive work environment.
• Access to state-of-the-art tools and technology.