Why do so many organizations struggle with their Experimentation Culture? And how can we win the experimentation and continuous improvement game? Establising a Culture of Experimentation that leverages all your potentials available, is so much bigger than just A/B-Testing. But for both, Testing and the bigger Experimentation game, there are some major obstacles that need to be overcome. Let’s discuss them.
Last week I had the honor to meet Frederick Mieke from Varify.io® A/B Testing. Many of my clients don’t use A/B-Testing at all. But nevertheless, very soon, we found huge common ground and our talk shifted to a crucial topic:

Continuous improvement is INCREDIBLY VALUABLE, but many organizations struggle to incorporate experimentation into their daily routines. Today, let’s have a look at the “why”.
typical challenges in A/B-Testing
It’s NOT ONLY about the typical known challenges in A/B-Testing:
➡️ having enough traffic for “statistical significance”
➡️ coping with fact that 70-80% of tests fail
➡️ solving technological issues
deeper challenges of experimentation culture
But it’s also and MAINLY about deeper challenges of experimentation culture in general
🚨 1. rethinking principles, often up to the C-Level!
🚨 2. smart balance of research vs. getting things done,
🚨 3. changing core processes of organizations,
🚨 4. psychology and internal communication,
🚨 5. overcoming skepticism and resistances.
These 5 “gaps of death” affect all levels of an organization. Experimenting via A/B-Testing tools here only scratches the surface. It’s much bigger. As nearly everything gets digitized, the real power lies in embracing all given possibilities.
An experimentation culture rejects non-improving changes and accepts only those based on data and facts. Across all levels. And this can collide with classical approaches to decision-making in so many ways.
Is it enough to simply let a junior marketer do some A/B-Tests?
And now, as Frederick pinpointed this very well, not few organizations “simply let a junior marketer do some A/B-Tests”. And think this topic is solved.
What happens?
You name it, the A/B-Testing project fails…
Frederick and I are discussing this further. How can we give more and better guidance for organizations navigating this difficult terrain?
TL;DR
By addressing and solving the 5 Experimentation Culture gaps of death, you increase chances for successful experimentation. Or to put it into a more general context, you take a big leap in leveraging digitisation.
Let’s bridge these gaps of death.
It’s so urgently needed nowadays.
Let’s ignite serious innovation and speed this up – gladly in your organization as well.
Contact me for your free sparring call:
Book your FREE SPARRING Call
Let’s have a first clarity check of your experimentation culture. Book your free 1:1 with me. We will reflect upon your major issues, and identify most important first steps.
More Blog Posts from this category
Vortrag “Datengetriebene Entscheidungen” – Als Gastdozent an der FH Aachen (14. November 2024)
Heute, am 14. November 2024, hatte ich die Gelegenheit, als Gastdozent an der FH Aachen...
How to get Web Analytics right – Part 2 – Strategy, Goals and KPI
A well-founded strategy for web analytics data analysis is key to an organizations...
How to get Web Analytics right – Part 1 – 3 Fatal Flaws in Your Digital Analytics Setup
During the last years I had the chance to see – and setup/maintain – many Digital...