About the role

Data Engineer

Job Summary:

The Data Engineer plays a critical role in designing, building, and optimizing data pipelines to support analytics and reporting solutions. This position ensures seamless data integration and automation, leveraging cutting-edge technologies that drive data-informed decision-making across the organization.

Key Responsibilities:

Design and implement robust ETL processes to extract, transform, and load data from various sources using tools like PySpark and Claude Code.
Develop and maintain data models within Databricks to ensure high-quality data is available for business intelligence tools.
Collaborate with data scientists and analysts to define data requirements and improve the overall data architecture.
Automate data pipeline workflows to enhance efficiency and reduce manual interventions.
Utilize Hive and SQL to query and analyze large datasets, ensuring data accuracy and integrity.
Visualize data insights by creating interactive dashboards and reports using Power BI and Tableau.

Requirements:

Bachelor's degree in Computer Science, Information Technology, or a related field.
Proven experience in data engineering roles, with extensive knowledge of SQL and Hive.
Strong proficiency in ETL process design and automation techniques.
Experience with big data technologies, including Databricks and PySpark.
Familiarity with data visualization tools like Power BI and Tableau.
Excellent problem-solving skills and the ability to work under tight deadlines.
Strong communication skills, with the ability to collaborate effectively with diverse teams.

Preferred Qualifications:

Experience with Genie or similar data orchestration tools.
Knowledge of cloud services, especially AWS or Azure.
Familiarity with machine learning concepts and their application in data analysis.
Certification in data engineering or related technology platforms.

Benefits:

Competitive salary and performance-based bonuses.
Comprehensive health, dental, and vision insurance.
Generous paid time off and flexible work hours.
Retirement savings plan with company matching.
Continuous learning opportunities, including training and certifications.
Work in a dynamic and inclusive environment with a focus on teamwork.

Data Engineer with Visualization