August 23, 2024
I can no longer hold a normal conversation. It’s the CRO Roundtable Roundup!
Thanks to Matt Beischel, Iqbal Ali, Slobodan Manić, Mike Kust, and Jorden Lentze for joining us. Want to get in on the action and talk with cool CRO people like this? Then join us next Friday.
This Time We Discussed:
- Reviewing A/B test tool capabilities and pricing
- Convert’s clear pricing is appreciated by clients for its simplicity and transparency
- VWO and Optimizely often come with high overage costs, impacting long-term affordability
- Eppo is praised for its ability to ensure data integrity in large-scale experimentation programs
- What are edge functions?
- Implementing new technologies on the edge requires careful architectural planning
- Can be used to overcome issues with heavy caching and CDN delays in A/B testing
- Cloudflare Workers enable fast, server-side processing at the edge, reducing latency
- Astro JS offers significant performance improvements, making websites extremely fast
- An untapped market potential exists for CRO tools incorporating edge functions for faster testing
- Workers at the edge are capable of performing complex tasks with minimal latency
- Cloudflare’s AI Workers can perform real-time tasks such as translating video content
- Benefits of test execution methods other than client-side
- Server-side testing can eliminate flickering and ad-blocker issues experienced with client-side tests
- SiteSpect assigns users to tests at the start of a new visit to avoid mid-session disruptions
- Using Z-score
- Accurately indicate the magnitude of a test’s impact, helping identify significant issues early
- Modified Z-test is effective in identifying large, negative impacts from experiments
- High traffic can lead to smaller standard deviations, making Z-scores more accurate
Quotes of the Week
Standout quips from this week’s roundtable
“You’re at your rant limit for the week” – Matt Beischel
“I know everything, this is insane” – Slobodan Manić
CRO Link Digest
Links to interesting, amusing, thought-provoking, or downright silly content shared at this week’s roundtable
- Nike: An Epic Saga of Value Destruction – A LinkedIn Article by Massimo Giunco
- How edge functions move your back end close to your front end – A Stack Overflow blog article
- Edge Functions Overview – Netlify documentation
- Astro JS – Documentation Homepage
- When to Stop A/B Experiments Early – A Medium article by Iqbal Ali
Off-Topic Sidebars
Experimentation isn’t the only thing we talk about at the CRO Roundtable. There’s often a healthy dose of discussion on shared interests, personal passions, and hobbies. This week we had some sidebars about:
- Dealing with procrastination
- Driven by anxiety and overthinking
- This leads to task avoidance
Off-Topic Shareables
- No off-topic shareables this week, sorry!