Data Engineer with Visualization
Job Summary:
We are seeking a skilled Data Engineer with a strong background in data
visualization to join our dynamic team. The ideal candidate will play a
critical role in designing and implementing robust data pipelines while
translating complex datasets into actionable insights for strategic
decision-making.
Key Responsibilities:
-
Develop and maintain scalable data pipelines using SQL, Hive, and PySpark to
support data ingestion and processing.
-
Automate ETL workflows to streamline data integration processes and enhance
operational efficiency.
-
Collaborate with cross-functional teams to gather requirements and ensure
data solutions meet business needs.
-
Create visually engaging dashboards and reports using Power BI and Tableau
to present data insights effectively.
-
Implement best practices in data management and governance to ensure data
quality and compliance.
-
Utilize Databricks and Genie for efficient data processing and
orchestration.
-
Participate in code reviews and contribute to the ongoing improvement of
data engineering processes.
Requirements:
-
Bachelor's degree in Computer Science, Data Science, or a related field.
-
At least 5 years of experience in data engineering, with a strong
understanding of data visualization techniques.
-
Proficient in SQL, Hive, and PySpark for data manipulation and analysis.
-
Experience with ETL automation tools and methodologies.
-
Solid understanding of data architecture concepts and frameworks.
-
Hands-on experience with Databricks and Genie for data processing.
-
Excellent problem-solving skills and ability to work under tight deadlines
in a fast-paced environment.
Preferred Qualifications:
-
Experience with cloud platforms and services such as AWS, Azure, or Google
Cloud.
-
Knowledge of advanced data visualization techniques and tools beyond Power
BI and Tableau.
-
Familiarity with machine learning concepts and tools.
-
Strong communication skills, with the ability to convey complex data-related
concepts to non-technical stakeholders.
-
Certifications in data engineering or relevant technologies would be a plus.
- .