About the role

Data Engineer

Job Summary:

We are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will leverage their expertise in SQL, Hive, and PySpark to enhance our data management processes and build robust data pipelines that drive insightful business decisions.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines using SQL, Hive, and PySpark to ensure efficient data flow and storage across various platforms.
Collaborate with data scientists and analysts to understand their data needs and deliver high-quality data sets for analytics and reporting.
Implement data models and architectures that support data integration and analytics; optimize performance for existing queries and datasets.
Utilize Claude Code to automate and enhance data processing workflows, ensuring accuracy and efficiency.
Create and manage data visualizations and dashboards using Power BI or Tableau to communicate data insights effectively.
Monitor and troubleshoot data pipeline operations, resolving any issues in collaboration with cross-functional teams.
Document data engineering processes, workflows, and architectures, promoting knowledge sharing within the team.

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field.
Minimum of 5 years of experience in data engineering or a related field.
Proficient in SQL for data querying and transformation tasks.
Experience with big data technologies, including Hive and PySpark.
Strong programming skills in Python, with a focus on data manipulation and analysis.
Familiarity with data visualization tools such as Power BI or Tableau for creating actionable insights.
Excellent problem-solving abilities and attention to detail, with strong communication skills to collaborate effectively.

Preferred Qualifications:

Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
Knowledge of data warehousing concepts and ETL processes.
Familiarity with machine learning concepts and tools, enhancing data pipelines for predictive analytics.
Experience with Agile methodologies and tools for project management.

Benefits:

Competitive salary and performance-based bonuses.
Comprehensive health, dental, and vision insurance.
Flexible working hours with remote work options.
Generous paid time off and holiday policies.
Professional development opportunities, including training and certifications.
Retirement savings plan with company contributions.
Access to wellness programs and employee assistance services.

DATA ENGINEER