Senior Manager - Experimentation and Digital Analytics Engineering

About the Role

Key Responsibilities

• Lead the experimentation engineering team and collaborate across organizational boundaries to deliver randomized controlled experimentation solutions across all digital customer touchpoints, including web, iOS, and Android platforms.
• Serve as the primary point of contact and subject matter expert for all experimentation and optimization engineering efforts, providing technical consulting and hands-on support to software developers, product managers, marketers, and other stakeholders on the design and execution of A/B/n and multivariate experiments.
• Scale experimentation engineering services to support hundreds of product and marketing teams, developing self-service tools and defining standardized processes to improve experiment velocity, trustworthiness, insight quality, and tracking.
• Define and maintain analytics data requirements, develop implementation guidelines, and ensure websites and mobile applications are properly implemented with accurate generation and reporting of key metrics.
• Integrate experimentation requirements into agile product development and CI/CD pipelines to enable rapid testing and validation of new features and ideas.
• Stay current with emerging technologies and trends in experimentation and analytics, evaluating and implementing platform enhancements using a buy-vs-build approach.
• Explore and integrate advanced experimentation platforms beyond Adobe Target, such as Optimizely, Eppo, LaunchDarkly, and other tools to enhance experimentation capabilities.
• Drive innovation by incorporating machine learning and AI-driven approaches to optimize and personalize user experiences.
• Collaborate with data science teams to leverage advanced analytics and predictive modeling for deeper insights and more effective experimentation strategies.
• Design and implement robust data architecture to support experimentation and analytics, ensuring data integrity, scalability, and accessibility.
• Develop and maintain data repositories that enable advanced analysis of experiment results, including data integration from multiple sources and platforms.
• Ensure data governance and compliance with industry standards.

Requirements

• Bachelor's or advanced degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in A/B testing and digital analytics, including platform implementation, test execution, and analysis.
• Proven leadership experience in building and scaling high-performing experimentation engineering teams.
• Solid understanding of the technical and statistical foundations behind randomized controlled experiments.
• Hands-on experience with experimentation platforms such as Adobe Target, Optimizely, etc., and digital analytics tools like Adobe Analytics and Google Analytics.
• Strong SQL skills and familiarity with web technologies (HTML, CSS) and client-side programming (JavaScript, Android, iOS) is a plus.
• Experience with data architecture, machine learning, and AI technologies to enhance experimentation and analytics capabilities.
• Strong collaboration skills to work effectively with cross-functional teams including data science, product management, and marketing.

Nice to Have

• Familiarity with data visualization tools such as Tableau or Looker.

Qualifications

• Bachelor's or advanced degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in A/B testing and digital analytics.

Benefits & Perks

• Healthcare (medical, dental, vision)
• Basic term and optional term life insurance
• Short-term and long-term disability
• Pregnancy disability and parental leave
• 401(k) and employer-funded retirement plan
• Paid vacation (from two to five weeks depending on salary grade and tenure)
• Up to 11 paid holiday opportunities
• Adoption assistance
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per year