Data Engineering Manager
Please share updated resume with the snapshot of LWD
Job Summary:
The Databricks Architect plays a pivotal role in designing and implementing
cutting-edge data solutions leveraging Databricks technologies. This
position is essential for driving innovation, improving data workflows, and
ensuring our data architecture meets the strategic needs of the
organization.
Key Responsibilities:
-
Design and implement scalable data architectures using Databricks,
Lakeflow, and Delta Lake.
-
Lead the integration of modern features such as Lakeflow Connect and
Databricks Apps into existing data systems.
-
Collaborate with cross-functional teams to define data requirements and
translate them into technical specifications.
-
Evaluate and optimize data processing frameworks and tools to enhance
performance and reliability.
-
Conduct training sessions and workshops for team members on best practices
in Databricks and big data solutions.
-
Establish governance and security policies for data sharing and management
across platforms.
-
Stay updated on industry trends and advancements in data technologies to
provide strategic insights.
Requirements:
-
10+ years of experience in data architecture and engineering with a focus
on cloud technologies.
-
Expertise in Databricks, Lakeflow, Delta Lake, and associated tools and
frameworks.
-
Strong programming skills in languages such as Python, Scala, or SQL.
-
Experience with data warehousing solutions and ETL processes.
-
Excellent problem-solving skills and a strong analytical mindset.
-
Proven ability to work collaboratively in a team environment and
communicate complex concepts clearly.
-
Relevant Databricks certifications are highly preferred.
Preferred Qualifications:
-
Experience leading large-scale data migration and transformation projects.
-
Familiarity with machine learning frameworks and their integration into
data pipelines.
-
Knowledge of data visualization tools such as Tableau or Power BI.
-
Experience with Agile methodologies and project management principles.
-
Strong network within the data engineering community for staying ahead of
emerging trends.
Benefits:
-
Competitive salary and performance-based bonuses.
-
Comprehensive health, dental, and vision insurance plans.
-
401(k) retirement plan with company match.
-
Flexible work hours and opportunity for remote work.
-
Professional development and continuing education reimbursement.
-
Generous paid time off and holiday schedule.
-
Access to cutting-edge technologies and tools to foster innovation.