Senior Data Engineer

Unity

San Francisco, CA

Full Time

Senior

10 days ago

Job Description

About the Role

The Unity Ads Platform team handles a vast array of data systems and tools, managing every aspect of the data life cycle, from ingestion and storage to processing, transformation, feature generation, and big data architecture. Our work supports diverse applications like simulations, game playing experiences, game monetization, and facilitating various Unity teams in creating exceptional tools and services for our users. This team plays a crucial role in the growth and success of various Unity Monetization products and enables game developers' success. We are seeking an experienced and talented Senior Data Engineer to join our team, collaborating closely with engineers, product specialists, and data experts to research, prototype, and develop world-class applications, services, and pipelines. This role offers the opportunity to shape work culture and solve complex data engineering challenges in a fast-paced environment.

Key Responsibilities

Design and optimize large-scale and complex next-generation data pipeline systems for efficiency, reliability, and cost-effectiveness.
Work closely with teams across product, engineering, data science and analytics to assist with designing and implementing data initiatives based on understanding their use cases.
Build a highly efficient end-to-end data pipeline to transform complex data which can be easily analyzed, ensuring data accuracy and reliability.
Implement data governance and modeling practices and optimize systems for speed and scalability.
Engage in on-call rotations applying your deep understanding of infrastructure to quickly identify and resolve complex issues.
Collaboratively work with cross-functional teams, including ML engineers, data scientists, and analysts teams to understand business and data needs and translate them into data-driven solutions focusing on scalability and cost-efficiency.
Contribute to data optimization projects across the company, utilizing your expertise to drive significant cost savings without sacrificing service performance.

Requirements

A background in Computer Science or Engineering, or equivalent data engineering experience with complex data systems.
Proficiency in cloud platforms such as GCP, AWS, or Azure, and expertise in databases, data storage concepts, and data infrastructure tools like Hadoop or Kafka.
Experience in batch, streaming, and real-time data processing using Spark, Flink etc.
A deep understanding of data warehousing principles, encompassing ETL/ELT, data modeling, and various data patterns such as SCD, CDC, snapshots, and partitioning.
Proficiency in programming languages such as Python, Go or Java.
Excellent problem-solving skills, with an ability to work in a fast-paced and dynamic work environment.
Outstanding interpersonal skills and the ability to work collaboratively with global teams across time zones.

Nice to Have

A mindset that appreciates engineering as a collective effort.
Hands-on experience with Protobuf, Kafka, Flink, BigQuery, Druid, Kubeflow.
Experience with Terraform, ArgoCD, Github Actions and similar tools used for CI/CD.
Operational experience in the ML or Data domain and its associated technologies.

Working at Unity

Unity is a proud equal opportunity employer committed to fostering an inclusive, innovative environment. We celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators.

Apply Now