A reader last week asked:
I love your guys’ methodology. I totally agree that asking prospects what they want is a really bad idea.
What’s your opinion on asking people for feedback after you’ve built and launched something based on Safari research?
For example: doing an early access program with people who are begging to start using the product–do you ask for (and trust) their feedback during a beta?
And this is where it gets tricky.
Most people give shit feedback
That’s just a fact of life: most people give shitty feedback, period. Some people — but not many — give decent feedback.
But everybody who gives feedback — including almost but not every person who runs their own business — gives the wrong kind of feedback.
Even the best feedback-givers will often say things like:
“It should x, and it should x in this way.”
This isn’t useful to you as it stands. You have to filter it through the lens of all their biases and blind spots, imagination and lack thereof. And of course the filter of, “What’s best for everyone?”
Great feedback is rarer than unicorns
Ideal feedback comes from the wisest and most self-aware customers:
“My goal is to achieve z. I would like to maybe achieve this by y mechanism. But maybe you have a better way. Or maybe it doesn’t fit with your app. Or maybe z is actually not a good goal at all.”
That’s great feedback…the kind that 1 in 100,000 may give.
How to deal with less-ideal feedback
The first rule is: Don’t take it at face value. That’s just not how people communicate. You have to ask them — your customers — and yourself:
- what’s the end goal of achieving z?
- why again?
- what else could be better?
- can you eliminate z entirely?
- what’s the bigger thing?
- does everybody need this? really? everybody?
- what’s the cost of doing it this way? for me, and for them?
It’s a lot of work. Yeah, being a responsible product steward is tough (but very rewarding.)
Good as-is feedback is situational
There’s another type of feedback that’s much more useful at face value. And that’s situational feedback, such as:
- I went to do x, but couldn’t find the button…or
- I entered y wrong because the form was confusing…or
- It takes too long/too many steps/too much work to do z…
- I need to get abc-data out of the app because…
That’s useful. That’s concrete, that’s not speculative at all. It’s constrained, it’s focused, it’s in reaction to what exists.
But speculation about new features is where you have to get super cautious, because 99.99% of people (yes, including us) can only imagine how they’ve done it before, never better, and they never question their own motives or goals.
Bottom line: You’re the boss.
The buck has to stop somewhere, and as usual, it stops with you.
You are always responsible for this judgment call. As the product-maker, you think & know more about the product (and your goals) than anyone else. A given individual customer can only think of him- or herself. You have to be better, do better.
You are responsible for thinking for all of them, as well as yourself.
That’s your job.
That’s what your customers pay you for.
If you don’t do Customer Interviews…
How do you come up with an MVP? How do you validate your ideas?
These questions are backwards. It’s better to observe than to ask. It’s better to research than to “validate.” It’s better to charge than to accept praise. It’s better to dispense with Ideas™ entirely because they make you their bitch.