Senior Manager of Data Engineering - Databricks

About the Role

Key Responsibilities

• Manage a team of data engineers to develop, maintain, and improve data pipelines, data architecture, and data models using Databricks.
• Design and implement scalable and efficient data processing solutions to meet business requirements.
• Work closely with other teams, including Data Science, Product, and Operations, to ensure data quality, accuracy, and compliance with regulations.
• Implement best practices for data governance, data security, and data privacy.
• Manage and prioritize multiple projects and initiatives simultaneously.
• Evaluate and recommend new technologies, tools, and processes to improve our data engineering capabilities.
• Collaborate with other managers to develop and execute strategies to drive the organization's data initiatives.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Systems, or related field.
• 6+ years of experience in data engineering with a focus on Bigdata and Apache Spark based solutions.
• 2 years of experience building and maintaining data pipelines using Databricks.
• 2 years of experience managing a team of data engineers.
• Strong understanding of distributed computing, data architecture, and data modeling.
• Familiarity with cloud-based data platforms such as AWS, Azure, or Google Cloud.
• Experience with SQL, Python, and other programming languages.
• Excellent problem-solving skills and ability to prioritize and manage multiple tasks.
• Strong communication and collaboration skills.
• Experience in data governance, data security, and data privacy.
• Familiarity with data security and privacy regulations such as GDPR and CCPA.

Nice to Have

• Databricks Certification(s).
• Familiarity with agile development methodologies.