Data Engineer Job Description
We are seeking a seasoned Data Engineer with 5-7 years of experience in data
engineering, cloud platforms and distributed systems, along with 2+ years of
hands-on experience with Palantir Foundry/ AIP & Palantir Ontology.
The ideal candidate will work on designing scalable data solutions, building
robust data pipelines, modelling enterprise datasets and enabling analytics
and AI/ML use cases on Palantir Foundry. Experience in the insurance domain is
a plus.
Key Requirements
-
5-7 years of overall experience in data engineering, building and
maintaining large-scale data pipelines and platforms.
-
2+ years of hands-on experience with Palantir Foundry, including data
ingestion, pipeline builder, transformations and working with Foundry
datasets and applications.
-
Experience building interactive applications using Foundry Workshop, Slate
and custom frontends using TypeScript.
-
Proficiency in programming languages such as Python, PySpark, and
TypeScript/JavaScript.
-
Strong experience with AWS services for data processing and storage (e.g.,
S3, Glue, Athena, Lambda, Redshift).
-
Deep understanding of microservices architecture and distributed systems.
-
Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch) and
their integration into data pipelines.
-
Experience with big data technologies like Snowflake.
-
Strong problem-solving and performance optimization skills.
-
Exposure to modern DevOps practices, including CI/CD pipelines and container
orchestration tools like Docker and Kubernetes.
-
Experience working in agile environments delivering complex data engineering
solutions.
-
Palantir Foundry certification or demonstrated project experience is highly
preferred.
-
Prior experience in the Insurance domain is highly desirable.
Additional Key Requirements
-
7+ years of work experience with Data Engineering
-
2+ years of work experience with Palantir
-
3+ years of work experience with Python (Programming Language)
© 2023 Company Name. All rights reserved.