Episode 26: When to Decide What Metrics to Track
https://youtu.be/6JnPEgVLDbo In this episode, Matt Beischel and Iqbal Ali discuss the process for determining the right metrics to track when running tests and performing research. The topic originated from a LinkedIn post by Nils Koppelman. Key points discussed include: Importance of Metrics: Metrics should be in a balanced “Goldilocks zone”—neither too few (leading to directionless […]
CRO Roundtable 215
August 23, 2024 I can no longer hold a normal conversation. It’s the CRO Roundtable Roundup! Thanks to Matt Beischel, Iqbal Ali, Slobodan Manić, Mike Kust, and Jorden Lentze for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us next Friday. This Time We […]
CRO Roundtable 214
August 16, 2024 Stay a while and listen. It’s the CRO Roundtable Roundup! Thanks to Matt Beischel, Iqbal Ali, Shiva Manjunath, Craig Sullivan, Nils Koppelmann, and Slobodan Manić for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us next Friday. One Sentence Takeaway Integrating […]
Episode 25: What’s Your Primary Metric?
https://youtu.be/rPXGo9XgtjI Matt and Iqbal explain how to select primary metrics for experiments and A/B tests. They explore the definition of a primary metric as the key metric used to evaluate the success or impact of changes being tested. They emphasize that while conversion rate is often considered a primary metric, it is not always the […]
CRO Roundtable 213
August 9, 2024 It’s just a thin veneer of paint on a wheel. It’s the CRO Roundtable Roundup! Thanks to Matt Beischel, Iqbal Ali, and Slobodan Manić for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us next Friday. One Sentence Takeaway Automating repetitive tasks using […]
CRO Roundtable 212
August 2, 2024 We need to do another iteration of this, and that’s fine. It’s the CRO Roundtable Roundup! Thanks to Matt Beischel, Iqbal Ali, and Craig Sullivan for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us this Friday, August 9. This Time We Discussed: […]
Episode24: Testing Big and Testing Small
https://www.youtube.com/watch?v=_sU-Ldlbi78 Matt Beischel and Iqbal Ali discuss the nuances of testing at different scales in experimentation—referred to as “testing big” and “testing small.” The conversation, initiated by a topic suggestion from regular CRO Roundtable attendee Shirley Lee, explores the complexity and impact of various tests. They emphasize that not all tests yield proportional outcomes; a […]
Episode22: Authenticity in Case Studies
https://www.youtube.com/watch?v=_sU-Ldlbi78 In this episode, Matt and Iqbal explore what constitutes a case study, emphasizing the need for transparency in reporting experiment results; including statistical data, sample sizes, and the analysis and recommendations derived from those statistics. Case studies should not only demonstrate competence but also avoid misleading claims of exceptionalism. Authentic case studies should provide […]
CRO Roundtable 193
February 16, 2024 I hope this message finds you well. It’s the CRO Roundtable Roundup! Thanks to Matt Beischel, Iqbal Ali, Craig Sullivan, and Jorden Lentze for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us this Friday, February 23. This Time We Discussed: […]