Specialist Software Engineer - BigData

Below is the JD :

Responsibilities:

We are looking for an experienced Senior Big Data Developer to lead our data engineering and migration initiatives. In this role, you will architect, develop, and optimize large-scale data processing and analytics solutions, with a strong focus on modernizing our Big Data ecosystem into Snowflake. You will work with advanced technologies to deliver high‑quality pipelines for data ingestion, transformation, storage, and processing. Your expertise in both traditional Big Data frameworks and Snowflake will play a key role in shaping our data modernization strategy while ensuring the performance, reliability, and scalability of our next‑generation data platform.
Lead the migration of existing Big Data (Spark/Hadoop/Hive) workloads to  Snowflake Lakehouse , ensuring scalable, high-quality solutions.

• Provide technical leadership in  data modeling, ELT/ETL design, performance tuning , and Snowflake best practices.
• Drive analysis, refactoring, and optimization of legacy code to align with Snowflake architecture.
• Oversee testing, validation, debugging, and automation of migrated pipelines.
• Collaborate closely with cross‑functional and distributed teams, representing the engineering team as the  SPOC  for status, risks, and delivery updates.
• Guide DevOps activities including CI/CD, environment setup, and release readiness.
• Mentor junior engineers, enforce coding standards, and ensure adherence to engineering guidelines.
• Participate in Agile ceremonies and ensure high-quality, defect‑free sprint deliveries.

Profile Required:

Core Experience

• 4+ years of experience in  Big Data engineering , with  strong hands-on expertise in Snowflake (2+ years) .
• Solid understanding of Snowflake components such as:
  • Virtual Warehouses ,  Micro-Partitioning ,  Clustering
  • Snowpipe ,  Streams ,  Tasks
  • Snowpark (Python)  for advanced transformations
• Strong experience in analyzing existing Big Data ecosystems (Spark/Hadoop/Hive) and designing scalable Snowflake-based solutions.

Technical Skills

• High proficiency in  SQL  and at least one language:  Python
• Experience building and optimizing scalable  ELT/ETL pipelines  on Snowflake.
• Knowledge of  DBT  (nice-to-have) and modular transformation frameworks.
• Strong understanding of data modeling, data integration patterns, and distributed computing fundamentals.
• Experience with cloud environments, preferably  Azure  (ADF, Databricks, Synapse etc.).
• Proven ability to troubleshoot performance issues across pipelines, queries, and compute layers.

Leadership & Collaboration

• Prior experience mentoring engineers or leading small technical teams.
• Strong communication and stakeholder management skills, including ability to coordinate with geographically distributed teams.
• Analytical and problem-solving mindset with ability to design solutions in complex data environments.