The GRO Roundtable
Casual conversations about experimentation. No sales pitch, no presentations, and no recording. You do NOT need a special invite to join; all are welcome. Open to experimenters and optimizers of any skill level. Meet and learn from CRO experts. Skill up. Ask questions. Participate!
Weekly, every Friday; don’t forget to add it to your calendar.
Europe – 4:00 PM UK / 5:00 PM CET
US – 8:00 AM PDT / 10:00 AM CDT / 11:00 AM EDT
Virtually, camera optional, but preferred.
This Week's Roundtable Topic
When Should You NOT Run A/B Tests?
Session 298: May 15, 2026
Here, have some conversation starters:
- How can small sample sizes undermine the validity of A/B test results?
- When might ethical considerations outweigh the benefits of running an A/B test?
- What risks arise from testing in environments with rapidly changing user behavior?
- How do technical limitations sometimes make A/B testing impractical or misleading?
- In what scenarios does prior knowledge render A/B testing unnecessary or redundant?
Notes From Recent Roundtables
GRO Roundtable 289
Predictive, pattern-based CRO approaches create an illusion of certainty that can mislead decision-making unless grounded in real experimentation and contextual understanding.
GRO Roundtable 287
Experimentation programs rarely stall for purely technical reasons; cultural incentives, flawed processes, weak data practices, and human bias all compete to shape outcomes.