Last week, I was in Cleveland for the Industry Product Conference. I spoke about the three mindsets that help a team find success as a continuous discovery team. You can view the video or read my slides and the full script below. Enjoy! Full Script The following script may deviate from what you see in […]
How to Improve Your Experiment Design (And Build Trust in Your Product Experiments)
I’ve got a pet peeve to share with you. If you’ve been following along with the growth of the Lean Startup and other experimental methods, you’ve probably come across this hypothesis format: We believe [this capability] Will result in [this outcome] We will have confidence to proceed when [we see these measurable signals] If you […]
3 Best Practices for Adopting Continuous Product Discovery
It’s easy to think you already do continuous product discovery. Most of the teams that I work with come into coaching thinking that they don’t need help. They’ve read the industry books, they attend the popular product conferences, and they follow all the leading blogs. They’ve got this. And they aren’t wrong. Most product teams […]
The Ladder of Evidence: Get More Value From Your Customer Interviews and Product Experiments
One of the best signs of an effective product team is a regular cadence of customer interviews and product experiments. But it’s not enough to simply check the box on these activities; we need to make sure that we do them effectively. Without a strong background in research methods, it’s hard to know how you […]
Why You Aren’t Learning As Much As You Could From Your Experiments
I love that A/B testing has become so popular. It’s an important tool in our toolbox. But it frustrates me that we use it so poorly. Most teams make one of the following two mistakes: They either gate releases with an A/B test trying to understand whether or not the feature had the intended impact […]
How to Choose Your Next Experiments
“I think we should use folders.” “I think we should use tags.” “I know. Let’s test them both.” Does this sound familiar? I bet it does. By far the most common mistake teams make when they are new to Lean Startup methodologies is they fall into the trap of substituting judgment with experimentation. Instead of […]
The Dos and Don’ts of Hypothesis Testing
I see many product managers struggling with how to design and run good product experiments. It’s hard to know what to test and for how long. Few of us are trained to think like scientists. The tools are hard to use. We often overgeneralize our conclusions. It’s great that experimentation is becoming more common practice, […]
Why You Can (And Should) Experiment When Building Enterprise Products
Every time I speak about hypothesis testing, I get a series of questions about how to run experiments from people working on enterprise products. The assumption behind these questions is that hypothesis testing only works with consumer Internet products. And the assumption behind that belief is that the only way to experiment is to run […]
