Lead Data Engineer

About the Role

Key Responsibilities

• Lead complex initiatives with broad impact and participate in large-scale software planning for the Technology area.
• Design, develop, and run tooling to discover problems in data and applications, and report issues to engineering and product leadership.
• Review and analyze complex software enhancement initiatives for business, operational, or technical improvements requiring in-depth evaluation.
• Make decisions in complex and multi-faceted data engineering situations, considering software options and compliance requirements to meet deliverables and drive organizational change.
• Collaborate and consult with internal partners to resolve highly risky data engineering challenges.
• Build and maintain optimized, highly available data pipelines that facilitate analysis and reporting.
• Review and analyze moderately complex business, operational, or technical challenges requiring evaluation of variable factors.
• Oversee data integration work, including developing data models, maintaining data warehouses and analytics environments, and scripting for data integration and analysis.
• Resolve moderately complex data engineering issues and lead teams to meet deliverables while understanding data policies, procedures, and compliance.
• Collaborate with colleagues and managers to resolve data engineering issues and achieve strategic goals.

Requirements

• 5+ years of Database Engineering experience or equivalent through work experience, training, military service, or education.
• 5+ years of experience implementing, managing, or utilizing data environments such as SQL Server, Oracle, Hadoop, etc.
• 3+ years of Python development experience.
• 4+ years of experience implementing Kafka-based solutions.
• 5+ years of experience with ETL tools like CDC, Informatica, and building ETL pipelines.
• 2+ years of experience designing and building Data Quality frameworks.

Nice to Have

• 4+ years of experience using standard BI tools such as Tableau, Power BI.
• Experience with CI/CD tools like Udeploy, Liquibase, Harness.
• Experience using Debezium connectors.
• Experience with tools like Qualytics or Talend.

Qualifications

• Educational background is not explicitly specified, but experience requirements imply a need for significant professional experience in data engineering and related fields.

Benefits & Perks

• Health benefits
• 401(k) Plan
• Paid time off
• Disability benefits
• Life insurance, critical illness insurance, and accident insurance
• Parental leave
• Critical caregiving leave
• Discounts and savings
• Commuter benefits
• Tuition reimbursement
• Scholarships for dependent children
• Adoption reimbursement