Data Engineer with Visualization

Data Engineer with Visualization

Job Summary:

The Data Engineer with Visualization role at EXL focuses on building and optimizing data pipelines and visualization components that drive strategic business decisions. This position plays a pivotal role in enabling data-driven insights through advanced ETL processes and reporting solutions.

Key Responsibilities:

• Design and implement scalable ETL pipelines using DataBricks and Genie for efficient data processing and transformation.
• Develop and maintain data models leveraging SQL, Hive, and PySpark to support analytics and reporting needs.
• Create and optimize visual reports and dashboards using Power BI and Tableau to provide actionable insights.
• Collaborate with cross-functional teams to gather requirements and understand data needs for various business functions.
• Monitor and troubleshoot data pipeline performance, ensuring data quality and integrity across systems.
• Document data engineering processes and maintain best practices for data governance and security.
• Continuously innovate and recommend improvements to existing processes and technologies.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in data engineering and ETL development.
• Proficiency in SQL, Hive, and PySpark for data processing and analytics.
• Hands-on experience with DataBricks and Genie for data pipeline creation.
• Solid understanding of data visualization tools, specifically Power BI and Tableau.
• Strong analytical and problem-solving skills with an attention to detail.
• Excellent communication skills to effectively collaborate with different teams and stakeholders.

Preferred Qualifications:

• Experience with cloud platforms, such as AWS or Azure.
• Familiarity with big data technologies and frameworks.
• Knowledge of data warehousing concepts and best practices.
• Experience with machine learning techniques and their application in data analysis.
• Certification in relevant data engineering tools or frameworks is a plus.