Data Engineer Job Description
We are seeking a seasoned Data Engineer with 5-7 years of experience in
data engineering, cloud platforms and distributed systems, along with 2+
years of hands-on experience with Palantir Foundry/ AIP & Palantir
Ontology.
The ideal candidate will work on designing scalable data solutions,
building robust data pipelines, modelling enterprise datasets and enabling
analytics and AI/ML use cases on Palantir Foundry. Experience in the
insurance domain is a plus.
Key Requirements
-
5-7 years of overall experience in data engineering, building and
maintaining large-scale data pipelines and platforms.
-
2+ years of hands-on experience with Palantir Foundry, including data
ingestion, pipeline builder, transformations and working with Foundry
datasets and applications.
-
Experience building interactive applications using Foundry Workshop,
Slate and custom frontends using TypeScript.
-
Proficiency in programming languages such as Python, PySpark, and
TypeScript/JavaScript.
-
Strong experience with AWS services for data processing and storage
(e.g., S3, Glue, Athena, Lambda, Redshift).
-
Deep understanding of microservices architecture and distributed
systems.
-
Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch)
and their integration into data pipelines.
- Experience with big data technologies like Snowflake.
- Strong problem-solving and performance optimization skills.
-
Exposure to modern DevOps practices, including CI/CD pipelines and
container orchestration tools like Docker and Kubernetes.
-
Experience working in agile environments delivering complex data
engineering solutions.
-
Palantir Foundry certification or demonstrated project experience is
highly preferred.
- Prior experience in the Insurance domain is highly desirable.
Additional Key Requirements
- 7+ years of work experience with Data Engineering
- 2+ years of work experience with Palantir
- 3+ years of work experience with Python (Programming Language)
© 2023 Company Name. All rights reserved.