November 8, 2024

Earn a free promo every 5 punches. It’s the CRO Roundtable Roundup!

Thanks to Matt Beischel, Iqbal Ali, Craig Sullivan, and Marcella Sullivan for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us this Friday, November 22.

One Sentence Takeaway

Effective experimentation requires rigorous validation, including replication and sensitivity testing, to prevent decision-making errors and foster data-driven growth.

This Time We Discussed:

  • Experimentation Practices

    • Why running replication tests is valuable
    • Consequences of failing to run A/A tests
    • Managerial skepticism of testing outcomes
    • Balancing speed and accuracy
  • Experimentation Events and Culture

    • Insights from the DDMA Experimentation Awards
    • Effective conference formats that generate deeper engagement
    • Strategies for networking and community building
  • AI and User Research

    • AI’s potential in research task automation and synthesis
    • Challenges with black-box AI processes in decision-making
    • Areas where AI complements versus replaces human effort
  • Conversion Optimization Tools

    • Recent feature updates to Convert
    • Designing effective pricing pages for CRO tools
    • Session replay and its role in user behavior research
  • Experimentation Approaches

    • Trade-offs between Bayesian and frequentist testing
    • Business cases for A/B testing in startups and small businesses
    • Overcoming objections to experimentation with evidence

Quotes of the Week

Standout quips from this week’s roundtable

  • “Effective testing isn’t about just doing; it’s about doing it right.” – Marcella Sullivan
  • “AI serves the choices; the human decides the meal.” – Craig Sullivan

CRO Link Digest

Links to interesting, amusing, thought-provoking, or downright silly content shared at this week’s roundtable

Off-Topic Sidebars

Experimentation isn’t the only thing we talk about at the CRO Roundtable. There’s often a healthy dose of discussion on shared interests, personal passions, and hobbies. This week we had some sidebars about:

  • Tell me about the time you met a famous person
    • Accidental bathroom encounters

Off-Topic Shareables

  • No off-topic shareables this week, sorry!