Experimentation Analyst

About the Role

Key Responsibilities

• Analyzing testing results based on statistical methods to provide statistically significant, sound recommendations to push winning solutions into production for all traffic.
• Determining test result statistical significance, confidence levels, optimal stopping points, and key takeaways.
• Defining new opportunities to test using data-driven observations and analysis.
• Documenting test results/implications, and using this knowledge to iterate upon test concepts and further optimize the customer experience.
• Collaborating with optimization specialists to QA A/B tests before launch, ensuring all critical and supporting event metrics are properly set up for accurate analysis.
• Advocating for data-driven decision-making and customer-centricity across all touchpoints of the digital product experience.
• Working with the Experimentation Lead to evangelize proper data governance, test design, and analysis methodology regarding all testing initiatives.
• Staying up-to-date on industry trends, new analytics products, and new features within existing platforms.

Requirements

• 4+ years of experience using analytics platforms such as Google Analytics, Tableau, Salesforce, Adobe Analytics, Amplitude, etc.
• Knowledge of testing platforms such as Optimizely, Google Optimize, and/or Adobe Target.
• Proven experience with Content Square software or other Digital Experience Analytics tools.
• Experience analyzing successful A/B tests for digital organizations.
• Ability to analyze data using statistical methods including hypothesis testing, sampling, variance, confidence intervals, regression, and wins within confidence levels.
• Critical and quantitative thinking skills, combining data-driven insights with a customer-first perspective.
• Ability to document and present results to different stakeholder audiences.
• Team player with a growth mindset and curiosity.

Nice to Have

• Experience with statistical hypothesis testing (sampling, variance, significance, confidence intervals, regression).
• Experience analyzing digital experimentation campaigns and tools.

Qualifications

• Educational background is not explicitly specified in the description.

Benefits & Perks

• A variety of perks, benefits, and options to support physical, mental, emotional, and financial health.
• Support for work-life balance and community involvement.
• Details available at https://careers.zoom.us/benefits.