About the role

Job Description: Data Engineer – Palantir Foundry

Location: Gurugram (Hybrid)
Experience: 3–6 Years

🧩 Role Overview

We are seeking a highly skilled Data Engineer with Palantir Foundry expertise to design, build, and scale enterprise-grade data platforms. The ideal candidate will have strong experience in AWS, big data technologies, microservices architecture, and modern DevOps practices , along with hands-on exposure or certification in Palantir Foundry .

This role involves building robust data pipelines, integrating machine learning workflows, and enabling scalable, high-performance data solutions in a cloud-native environment.

🎯 Key Responsibilities

Design, build, and maintain scalable ETL/ELT data pipelines on cloud platforms
Develop and manage data workflows using Palantir Foundry (Pipeline Builder, Code Workbooks, Ontology, etc.)
Implement data processing solutions using Apache Spark / PySpark
Integrate and manage data on AWS services such as S3, Glue, Athena, Lambda, and Redshift
Build and manage microservices-based data architectures
Integrate AI/ML models into data pipelines and workflows
Optimize performance, scalability, and reliability of data systems
Implement CI/CD pipelines and follow DevOps best practices
Use Docker and Kubernetes for containerization and orchestration
Collaborate in Agile environments to deliver high-impact data engineering solutions
Troubleshoot and resolve complex data and system performance issues

✅ Key Requirements

3–6 years of hands-on experience in Data Engineering
Proven hands-on experience or certification in Palantir Foundry (highly preferred)
Strong experience with AWS cloud services :
- S3
- Glue
- Athena
- Lambda
- Redshift
Strong programming skills in Python and PySpark
Hands-on experience with Apache Spark and Kafka
Experience with Snowflake (preferred)
Solid understanding of microservices architecture and distributed systems
Familiarity with AI/ML frameworks such as:
- TensorFlow
- PyTorch
Experience with DevOps and CI/CD tools
Experience with Docker and Kubernetes
Strong problem-solving and performance optimization skills
Experience working in Agile / Scrum environments

🎓 Qualifications

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
Relevant certifications in AWS, Palantir, or Big Data technologies are a plus

🏆 Preferred Candidate Profile

Prior experience working on Palantir Foundry projects
Strong cloud-native data engineering background
Experience integrating data pipelines with ML workflows
Background in large-scale, enterprise data platforms

🔑 Key Skills

Palantir Foundry, AWS, PySpark, Python, Apache Spark, Kafka, Snowflake, Microservices, CI/CD, Docker, Kubernetes, Data Pipelines, ETL/ELT, Cloud Data Engineering