Data Analytics Engineer

About the Role

Key Responsibilities

• Architect and lead the development of complex ETL pipelines and data workflows using Databricks and Apache Spark
• Help lead the design and evolution of our data lake architecture in AWS and Databricks Unity Catalog
• Optimize Spark applications for performance, cost-efficiency, and scalability
• Define data engineering best practices and design patterns for the organization
• Mentor junior engineers and provide technical leadership across teams
• Collaborate with data science, ML, and other product teams on requirements and develop PoCs
• Evaluate and integrate new technologies into our data platform
• Lead technical design reviews and contribute to strategic roadmap planning
• Implement robust monitoring, alerting, and disaster recovery systems

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred)
• 7+ years of experience in data engineering and experience working with Apache Spark
• Experience with common storage types (AVRO, Parquet, Delta, Iceberg, ORC)
• Experience with at least one programming language (Python, Scala, or Java)
• Extensive experience with AWS data services (S3, EMR, Glue, Lambda, Step Functions)

Nice to Have

• Expertise with Databricks platform, including Delta Lake and Databricks workflows
• Experience with SQL, optimized big data queries, and tuning large-scale data processing workloads
• Experience with real-time data processing using Structured Streaming, Kafka, or Kinesis
• Experience designing and implementing data lakes and data warehousing solutions
• Experience with Infrastructure as Code using Terraform

Qualifications

• Formal educational background including a Bachelor's degree in relevant fields; Master's preferred

Benefits & Perks

• Access to quality medical, dental and vision insurance
• A 401(k) plan with Cisco matching contribution
• Short and long-term disability coverage
• Basic life insurance and wellbeing offerings
• Up to twelve paid holidays per year, including one floating holiday and a day off for birthdays
• Vacation time accrual and flexible time off policies
• Paid sick time off with carryover options
• Paid time off for critical or emergency issues and community volunteering