Novelty and Familiarity Effects
Novelty and familiarity effects are often overstated but rarely proven in practice.
Test Targeting Conditions
We cover the basics of test targeting; including triggering mechanisms, multi-stage triggering and tool differences with guest Jonas Alves.
How Many Metrics Should You Track?
What is the ideal number of metrics to track during tests? Too few risks inaction and too many can cause analysis paralysis.
Episode 26: When to Decide What Metrics to Track
The importance of selecting the right metrics for tests and research.
Episode 25: What’s Your Primary Metric?
Your primary metric should align with specific goals rather than solely focusing on conversion rates. Consider multiple metrics to gain comprehensive insights.
Episode24: Testing Big and Testing Small
https://www.youtube.com/watch?v=_sU-Ldlbi78 Matt Beischel and Iqbal Ali discuss the nuances of testing at different scales in experimentation—referred to as “testing big” and “testing small.” The conversation, initiated by a topic suggestion from regular CRO Roundtable attendee Shirley Lee, explores the complexity and impact of various tests. They emphasize that not all tests yield proportional outcomes; a […]
Episode22: Authenticity in Case Studies
https://www.youtube.com/watch?v=_sU-Ldlbi78 In this episode, Matt and Iqbal explore what constitutes a case study, emphasizing the need for transparency in reporting experiment results; including statistical data, sample sizes, and the analysis and recommendations derived from those statistics. Case studies should not only demonstrate competence but also avoid misleading claims of exceptionalism. Authentic case studies should provide […]