Senior Manager - Experimentation and Digital Analytics Engineering

About the Role

Key Responsibilities

• Lead the experimentation engineering team and collaborate across organizational boundaries to deliver randomized controlled experimentation solutions across all digital customer touchpoints, including web, iOS, and Android platforms.
• Serve as the primary point of contact and subject matter expert for all experimentation and optimization engineering efforts. Provide technical consulting and hands-on support to software developers, product managers, marketers, and other stakeholders on the design and execution of A/B/n and multivariate experiments.
• Scale experimentation engineering services to support hundreds of product and marketing teams. Develop self-service tools and define standardized processes to improve experiment velocity, trustworthiness, insight quality, and tracking.
• Define and maintain analytics data requirements. Develop implementation guidelines and ensure websites and mobile applications are appropriately implemented, with accurate generation and reporting of key metrics.
• Integrate experimentation requirements into agile product development and CI/CD pipelines. Enable a scalable experimentation framework to test and validate new features and ideas rapidly.
• Stay current with emerging technologies and trends in experimentation and analytics. Evaluate and implement platform enhancements using a practical buy-vs-build approach.
• Explore and integrate advanced experimentation platforms beyond Adobe Target, such as Optimizely, Eppo, LaunchDarkly, and other market-leading tools to enhance experimentation capabilities.
• Drive innovation in experimentation methodologies by incorporating machine learning and AI-driven approaches to optimize and personalize user experiences.
• Collaborate with data science teams to leverage advanced analytics and predictive modeling for deeper insights and more effective experimentation strategies.
• Design and implement robust data architecture to support experimentation and analytics needs, ensuring data integrity, scalability, and accessibility.
• Develop and maintain data repositories that enable advanced analysis of experiment results, including the integration of data from multiple sources and platforms.
• Ensure data governance and compliance with industry standards.

Requirements

• Bachelor's or advanced degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in A/B testing and digital analytics, including platform implementation, test execution, and analysis.
• Proven leadership experience in building and scaling high-performing engineering teams focused on experimentation.
• Solid understanding of the technical and statistical foundations behind randomized controlled experiments.
• Hands-on experience with leading experimentation platforms (e.g., Adobe Target, Optimizely), digital analytics tools (e.g., Adobe Analytics, Google Analytics), and data visualization tools (e.g., Tableau, Looker).
• Strong SQL skills. Familiarity with web technologies (HTML, CSS) and client-side programming (JavaScript, Android, iOS) is a plus.
• Experience with data architecture, machine learning, and AI technologies to enhance experimentation and analytics capabilities.
• Strong collaboration skills to work effectively with cross-functional teams, including data science, product management, and marketing.
• Expertise in data architecture and data management to ensure the necessary infrastructure for advanced analysis of experiment results.

Nice to Have

• Familiarity with advanced experimentation platforms beyond Adobe Target, such as Eppo, LaunchDarkly.
• Experience with implementing and leveraging machine learning and AI-driven approaches in experimentation.
• Knowledge of agile development processes and CI/CD pipelines.

Qualifications

• Bachelor's or advanced degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in A/B testing and digital analytics.

Benefits & Perks

• Healthcare (medical, dental, vision)
• Basic term and optional term life insurance
• Short-term and long-term disability
• Pregnancy disability and parental leave
• 401(k) and employer-funded retirement plan
• Paid vacation (from two to five weeks depending on salary grade and tenure)
• Up to 11 paid holiday opportunities
• Adoption assistance
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year