Not redeemable for cash except where required by law. It’s the CRO Roundtable Roundup!
Thanks to Matt Beischel, Iqbal Ali, Shiva Manjunath, Craig Sullivan, and Shirley Lee for joining us.
Want to get in on the action and talk with cool CRO people like this?
One Sentence Takeaway
I’m a busy person; give me the TL:DR
Clear, adaptable experimentation systems built around existing data workflows lead to smoother processes and better decision-making.
The Notes
What we discussed this week
- Tool Valuations and Acquisitions
- EPPO acquisition by Datadog sparked industry interest
- StatSig’s $1B valuation seen as inflated
- Valuations are tied more to the client base than to product quality
- Past examples: Optimizely and Hotjar becoming platform components
- Enterprise Tool Trends
- VWO may be heading toward enterprise-only pricing
- Convert and VWO usage patterns vary by agency maturity
- Tool usage volume increases with agency experience
- Experimentation Culture and Infrastructure
- Organizational mindset often blocks velocity
- Importance of tracking time between idea to launch
- Database-as-a-spreadsheet tools like Airtable used to streamline experimentation tracking
- AI and Automation
- Smaller agencies rely more on AI tools
- Automation and API-first tools are seen as future necessities
- Vendor tools must support seamless integration
- Client Management and Influence
- CEOs’ involvement increases with visible ROI
- Betting on test outcomes as an engagement tactic
- Clear reporting can justify premium consulting fees
- Pricing Research Methodologies
- Gabor-Granger method discussed for price optimization
- Helps narrow pricing before A/B testing
- Quantitative surveys identify ideal pricing sweet spots
- Low-Effort Test Wins
- Simple copy/UI changes yield high ROI
- Need to evaluate effort vs impact, not just time live
- Shifts in Agency Services
- Move from marketing-led to product-led experimentation
- Clients want to learn, not just outsource
- Strategic services now more in demand
Hey Experimenter!
We’ll be kicking off the summer 2025 Experimentation Elite conference with our first-ever LIVE CRO Talks Roundtable! We want to see you there; come say hi!
- When: June 4th & 5th
- Where: Birmingham, UK
Use discount code CROTALKS10 for 10% off.
The Quotes
Standout quips from this week
- “I’m not here to predict the winners. I’m here to run the experiments so that you know what the winner is.” — Craig Sullivan
- “The test is going to go the way the test goes. Get used to it.” — Craig Sullivan
Book Club
Relevant reads recommended this week
- No books this week, sorry!
CRO Link Digest
Useful and thought-provoking content shared this week
- Gabor-Granger Pricing Method – blog article from Conjointly
- Gabor-Granger Method – topic entry on Wikipedia
Off-Topic Sidebars
Experimentation isn’t the only thing we talk about at the CRO Roundtable. There’s often a healthy dose of discussion on shared interests, personal passions, and hobbies.
- Comic book sales
- Challenges related to self-publishing and shipping
- Garden talk
- Potting dahlias
Sidebar Shareables
Amusing sidebar content shared this week
- No sidebar shareables this week, sorry!