Experimentation Analyst

About the Role

Key Responsibilities

• Analyzing testing results based on statistical methods to provide statistically significant, sound recommendations to push winning solutions into production for all traffic.
• Determining test result statistical significance, confidence levels, optimal stopping points, and key takeaways.
• Defining new opportunities to test using data-driven observations and analysis.
• Documenting test results/implications, and using this knowledge to iterate upon test concepts and further optimize the customer experience.
• Collaborating with optimization specialists to QA A/B tests before launch, ensuring all critical and supporting event metrics are properly set up for accurate analysis.
• Advocating for data-driven decision-making and customer-centricity across all touchpoints of the digital product experience.
• Working with Experimentation Lead to evangelize proper data governance, test design, and analysis methodology regarding all testing initiatives.
• Staying up-to-date on industry trends, new analytics products, and new features within existing platforms.

Requirements

• 4+ years of experience using analytics platforms such as Google Analytics, Tableau, Salesforce, Adobe Analytics, Amplitude, etc.
• Knowledge of testing platforms such as Optimizely, Google Optimize, and/or Adobe Target.
• Proven experience with Content Square software or other Digital Experience Analytics tools.
• Experience analyzing successful A/B tests for digital organizations.
• Experience using statistical methods to analyze data, including statistical hypothesis testing (sampling, variance, statistical significance, confidence intervals, regression, wins within confidence levels, etc.).
• Ability to think critically and quantitatively, combining data-driven insights with a customer-first perspective.
• Ability to document and present results to differing stakeholder audiences.

Nice to Have

• Experience with statistical hypothesis testing methods such as sampling, variance analysis, confidence intervals, and regression.
• Experience with digital experience analytics tools beyond Content Square.

Qualifications

• Educational background is not explicitly specified in the description.

Benefits & Perks

• A variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health.
• Support for work-life balance and community contribution.
• Competitive salary with consideration of base salary, bonus, and equity value.
• Location-based compensation structure.