About the role

Lead Big Data Engineer

Job Summary:

We are seeking a skilled Lead Big Data Engineer with 7-9 years of experience to join our dynamic team. In this role, you will drive the design and development of advanced data solutions that empower our organization to make informed decisions and enhance operational efficiency.

Key Responsibilities:

Lead the architecture, design, and development of scalable big data solutions using a variety of technologies.
Collaborate with data scientists and analysts to understand data requirements and deliver reliable data pipelines.
Manage end-to-end data lifecycle processes, including ingestion, storage, processing, and visualization.
Develop and optimize ETL processes to ensure high performance and reliability of data flows.
Conduct code reviews and provide mentorship to junior engineers, promoting best practices in big data engineering.
Stay abreast of industry trends and emerging technologies to continuously improve application performance and scalability.
Implement data quality strategies and ensure compliance with data governance policies.

Requirements:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
7-9 years of experience in big data engineering with a strong understanding of data architecture and storage solutions.
Proficiency in big data technologies such as Hadoop, Spark, Kafka, and related frameworks.
Strong programming skills in languages such as Java, Scala, or Python.
Experience with SQL and NoSQL databases (e.g., HDFS, MongoDB, Cassandra).
Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment.
Strong communication skills with the ability to present complex technical concepts to non-technical stakeholders.

Preferred Qualifications:

Familiarity with cloud-based platforms such as AWS, Azure, or Google Cloud for big data solutions.
Experience with containerization technologies like Docker and orchestration tools like Kubernetes.
Knowledge of machine learning concepts and data analytics frameworks.
Prior experience in leading teams and managing projects in a related field.

Benefits:

Competitive salary with performance-based bonuses.
Comprehensive health and wellness benefits, including medical, dental, and vision coverage.
Flexible work hours and the option for remote work.
Generous paid time off policy, including vacation and paid holidays.
Professional development opportunities, including training and certifications.
Innovative work environment with a focus on collaboration and creativity.
Employee engagement programs and fun company events.

lead big data enginner