About the role

Azure & AWS Data Engineer

Job Summary:

We are seeking a skilled Azure & AWS Data Engineer to join our dynamic team. In this role, you will leverage your expertise in cloud platforms and programming to design, implement, and maintain scalable data solutions that drive business insights and fuel decision-making across the organization.

Key Responsibilities:

Design and develop robust data pipelines on Azure and AWS to facilitate efficient data extraction, transformation, and loading (ETL).
Implement data storage solutions in both Azure and AWS, ensuring optimal performance and security according to best practices.
Utilize Python and PySpark to execute complex data processing tasks, optimizing code to enhance performance.
Write and optimize SQL queries for data retrieval and manipulation, ensuring data integrity and quality.
Collaborate with cross-functional teams to gather requirements and assess data needs, ensuring that data solutions align with business objectives.
Conduct troubleshooting and debugging of data solutions to resolve issues and enhance system performance.
Document data engineering processes and maintain metadata for improved data governance.

Requirements:

5-8 years of experience as a Data Engineer, specializing in Azure and AWS environments.
Strong proficiency in Python and PySpark for data processing and transformation tasks.
Extensive experience with SQL for data querying and manipulation.
Hands-on experience with Azure Data Factory, Azure Data Lake, AWS Glue, and other ETL tools.
Understanding of data modeling concepts and best practices in data warehousing.
Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
Excellent problem-solving skills and the ability to work effectively in a team-oriented environment.

Preferred Qualifications:

Experience with big data technologies such as Hadoop or Spark.
Knowledge of data visualization tools (e.g., Tableau, Power BI) for reporting purposes.
Familiarity with containerization technologies (e.g., Docker, Kubernetes) for cloud deployment.
Certification in Azure or AWS data engineering or related fields.
Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders.

Benefits:

Competitive salary with performance-based bonuses.
Comprehensive health, dental, and vision insurance plans.
Flexible working hours with remote work opportunities.
Professional development programs and certification reimbursements.
Generous paid time off and holiday leave policy.
Collaborative and inclusive work environment focused on innovation.
Access to the latest technology and tools to enhance your work experience.

azurre+ aws data engineer