Job Description
Candidate should Provide technical expertise in needs identification, data
modeling, data movement, and translating business needs into technical
solutions with adherence to established data guidelines and approaches from a
business unit or project perspective. Good knowledge of conceptual, logical,
and physical data models, the implementation of RDBMS, operational data store
(ODS), data marts, and data lakes on target platforms (SQL/NoSQL). Oversee and
govern the expansion of existing data architecture and the optimization of
data query performance via best practices. The candidate must be able to work
independently and collaboratively.
Mandatory Skills
- 8+ Years of experience as a Data Engineer
-
Strong technical expertise in SQL Advanced SQL querying skills (joins,
subqueries, CTEs, aggregation)
-
Strong knowledge of joints and common table expressions (CTEs)
- Strong experience with Python
- Experience in Snowflake, ETL, SQL, CI/CD
-
Strong expertise in ETL process and with various data model concepts
-
Knowledge of Star Schema and snowflake schema
-
Good to know about AWS services such as S3, Athena, Glue, EMR/Spark with a
major emphasis on S3 and Glue.
Nice to Have
-
Experience with Big Data Tools and technologies
-
Good Understanding of data structures and data analysis
-
Knowledge of Insurance Domain is an addition.
Responsibilities
-
Understand and translate business needs into data models supporting
long-term solutions.
-
Perform reverse engineering of physical data models from databases and SQL
scripts.
-
Analyze data-related system integration challenges and propose appropriate
solutions.
-
Assist with and support setting the data architecture direction (including
data movement approach, architecture/technology strategy, and any other
data-related considerations to ensure business value).
Responsibilities for Internal Candidates
- Design and implement data pipelines.
- Optimize data processing and storage.
-
Ensure data solutions meet performance standards.
- Provide technical support.
- Collaborate with stakeholders.
Qualifications for Internal Candidates
Bachelor's/Master's in Engineering 2-5 years