Lead Data Engineer

About the Role

Key Responsibilities

• Build high quality, scalable, and resilient distributed systems that support analytics platforms.
• Manage and optimize data pipelines that deliver curated data for key analytics consumers and initiatives.
• Implement solutions for near real-time and batch analytical processes to enable business decision-making.
• Extend the next generation of the data ecosystem and operationalize urgent data and analytics initiatives.

Requirements

• Bachelor's degree in data management, computer science, information systems, data/analytics, or a related field, or equivalent work experience.
• 3+ years of experience in Data Engineering with AWS cloud services.
• Strong understanding of data modeling, ETL frameworks, and big data architectures.
• Minimum 2 years of experience working for a property casualty insurance company.
• Strong expertise in AWS services such as Glue, Lambda, S3, Athena, S3 Tables, Apache Iceberg table formats.
• Proficiency in Python, SQL, and Apache Spark (Pyspark) for data processing and analytics.
• Experience with Git, Jenkins, Bitbucket, or similar version control systems.
• Experience implementing CI/CD pipelines with UDeploy.
• Hands-on experience with Infrastructure as Code (IaC) tools such as CDK, Terraform.
• Demonstrated success in integrating large, heterogeneous datasets and automating data preparation tasks.
• Exceptional analytical, quantitative, and logical problem-solving abilities.
• Ability to communicate effectively with IT and business personnel.
• Capacity to work independently or collaboratively and manage time effectively on high-priority projects.

Nice to Have

• Basic understanding of data science platforms.

Qualifications

• Bachelor's degree in a relevant field or equivalent work experience.

Benefits & Perks

• Medical, dental, vision coverage, short- and long-term disability, and life insurance.
• Paid vacation days (at least 13 in the first 12 months), with accrual starting immediately.
• 14 paid holidays observed annually.
• Sick time: 6 days at hire, plus 6 additional days after 90 days of employment.
• Generous 401(k) plan with company match, immediate vesting, and annual 3% employer contribution.
• Annual Success Sharing Plan based on company performance.
• Paid parental bonding leave.
• Student Loan Repayment and Tuition Reimbursement programs.
• Wellness and fitness reimbursement.
• Employee community involvement and opportunities for advancement.