Senior Data Engineer

·        Lead and mentor junior data engineers

·        Design, build and deploy ELT pipelines and data management processes.

·        Operationalise ELT job workflow with reliable error/exception handling and rollback framework.

·        Build and oversee data architecture & pipelines platforms and systems, managing the flow of data from internal and external sources by leveraging both distributed and local structures.  

·        Participate in developing, designing, configuring, and documenting database architecture.

·        Monitor and improve data loading performance.

·        Working with CI/CD pipelines to manage and execute releases

·        Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project

·        Conform to agile development practices – Evolutionary design, refactoring, continuous integration/delivery, test-driven development.

·        Work collaboratively with Business Partner Team and Business Stakeholder during projects scoping and feasibility phases as a SME for concept investigation/viability and technical impact; Identify and communicate technical risks and mitigations.

·        Provide production support for data load jobs.

·        Write customized query to generate automatic periodic reports.

·        Maintain or upgrade existing applications.

·        Attend key design meetings and provide support.

Skill Requirements  

·        Bachelor’s or Master degree in Computer Science, Engineering, Mathematics or other technical field is highly preferred.

·        10+ years experience with complex data solutions

·        Experience in creating and managing Azure Data Factory pipelines and writing TSQL (views/functions/stored procedures).

·        Experience in managing Azure Data Lake structure and security

·        Proven experience with data modeling, and working with star schema, snowflake schema

·        Ability to understand and communicate business requirements from non-technical stakeholders while simultaneously managing their expectations.

·        Experience with the full development life cycle of an application stack - from architecture through test and deployment.

·        Experience in Master Data management solutions.

·        Experience in data warehouse analysis and design, with full knowledge of data warehouse methodologies and data modelling.

·        Unit testing low level components – SQL scripts, Stored Procedures, ETL/ELT modules; Integration testing data transition points; Performance, load and stress testing.

·        Knowledge and experience in software development methodology and toolset for implementing, lifecycle and management – Agile methodology.

·        GIT code repository and branching strategies; Microsoft Release Management and any deployment tools; Azure DevOps knowledge.

·        Experience with Azure cloud solutions; Knowledge of Azure Data Factory, Azure Automation, Azure Data Lake, Azure Synapse, Azure Purview, Azure KeyVault, and Azure Batch. 

·        Experience with Google Cloud Platform solutions; knowledge of Google BigQuery, Google Storage, and Google CloudRun

·        Experience with APIs.

·        Team player

·        Organized and detail oriented

·        Excellent communication, presentation, and writing skills  

·        Thrives in a fast paced, constantly changing environment

·        You’re open: We are inclusive and collaborative; we encourage the free exchange of ideas; we respect and celebrate diverse views. We are open-minded: to new ideas, new partnerships, new ways of working.

·        You’re optimistic: We believe in the power of creativity, technology and talent to create brighter futures or our people, our clients and our communities. We approach all that we do with confidence: to try the new and to seek the unexpected.

·        You’re extraordinary : we are stronger together: through collaboration we achieve the amazing. We are creative leaders and pioneers of our industry; we deliver extraordinary every day.