Azure data engineer

Azure Data Engineer

Job Summary:

We are seeking a skilled Azure Data Engineer to join our dynamic team. This hybrid role will leverage your expertise in Databricks, Azure, Python, PySpark, and SQL to design, develop, and maintain robust data solutions that drive our organization's data strategy and support critical business initiatives.

Key Responsibilities:

• Design and develop scalable data pipelines using Azure technologies and Databricks to ensure efficient data processing and analytics.
• Create and maintain robust ETL processes using Python and PySpark for data transformation and integration across various sources.
• Collaborate with cross-functional teams to identify data needs and develop solutions to improve data accessibility and quality.
• Manage and optimize SQL databases for reporting and analytics, ensuring high performance and reliability.
• Implement best practices for data governance, security, and compliance within Azure environments.
• Monitor and troubleshoot data pipeline performance issues, providing timely resolutions to ensure uninterrupted data flow.
• Contribute to documentation of data architecture, processes, and workflows to facilitate knowledge sharing and team collaboration.

Requirements:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience working with Azure services, including Azure Data Lake, Azure SQL Database, and Azure Databricks.
• Strong programming skills in Python and proficiency in PySpark for data processing tasks.
• Solid experience with SQL and relational databases for data manipulation and querying.
• Excellent problem-solving skills and ability to work in a fast-paced, hybrid work environment.
• Familiarity with data modeling concepts and data warehousing principles.
• Strong communication skills and ability to articulate technical concepts to non-technical stakeholders.

Preferred Qualifications:

• Experience with additional cloud platforms (AWS, Google Cloud) and their data solutions.
• Knowledge of data visualization tools such as Power BI or Tableau to support decision-making processes.
• Certification in Azure Data Engineering or a related field.
• Familiarity with machine learning frameworks and their integration with data solutions.
• Experience with DevOps practices in data pipeline development, including CI/CD processes.

Benefits:

• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Flexible working hours and a hybrid work environment to support work-life balance.
• Generous vacation policy and paid time off.
• Professional development and continuous learning opportunities.
• Retirement savings plan with company match.
• Employee wellness programs and team-building activities.