You Don’t Need a Dashboard to See the Truth

By Ty Sutherland

Product-market fit is one of those phrases that gets thrown around in strategy meetings until it loses all meaning. But the underlying question is simple: does your product solve a real problem for real people, and do those people keep coming back because of it?

Most discussions about evaluating product-market fit assume you have a data science team, a product analytics platform, and an experimentation framework. Most managers don’t have any of those things. What you do have is access to customers, conversations, sales data, and your own judgment.

That’s enough to get a clear picture. Here’s how to use it.

Start With the 40% Test

The most widely used heuristic for product-market fit comes from entrepreneur Sean Ellis: ask your active users, “How would you feel if you could no longer use this product?” If 40% or more say they would be very disappointed, you likely have product-market fit. If fewer than 40% say that, you probably don’t.

You don’t need a survey tool or a statistician to run this. You need a list of active users and a way to reach them—email, Typeform, or even a phone call works fine.

A few things to keep in mind when you run this:

• Only send it to users who have engaged with the product in the last two weeks. Inactive users will skew your results toward “not disappointed.”
• Keep the question exactly as written. Changing the wording changes what you’re measuring.
• Pay as much attention to the open-ended follow-up (“What would you use instead?”) as you do to the percentage. The substitutes people name tell you who you’re really competing with.

If you’re below 40%, don’t panic. The follow-up question—”What type of person do you think would benefit most from this product?”—often reveals a smaller segment that does have strong fit. Your next move is to focus there, not to try to fix the whole product at once.

Read Retention Before Anything Else

If you have access to any usage data at all, look at retention first. Revenue can be misleading. Acquisition can be bought. Retention is honest.

A simple retention curve tells you whether the people who tried your product are still using it. Plot the percentage of users who are still active at week one, week two, week four, and week eight after their first use. If the curve flattens out above zero and stays there, you have a core of people who find ongoing value. If it drops to near zero within a few weeks, the product isn’t delivering on its promise.

You don’t need a BI tool for this. A spreadsheet with signup dates and last-activity dates is enough to build this picture. Pull the data, sort it, and bucket it by cohort. It takes an hour and tells you more than most fancy dashboards.

A useful benchmark: if 20-30% of users are still active after eight weeks, that’s a meaningful signal of fit in most B2B contexts. Consumer products often need higher numbers. The exact threshold matters less than the shape of the curve—is it flattening, or is it still dropping?

Talk to the People Who Stayed and the People Who Left

Quantitative data tells you what is happening. Qualitative conversations tell you why. Both matter, and you can get useful qualitative data without a research team.

Focus your conversations on two groups:

• Power users: the customers who use your product most frequently and who would be very disappointed to lose it. These people can tell you exactly what job the product is doing for them and what makes it irreplaceable.
• Churned users: people who tried the product and stopped. These conversations are uncomfortable but essential. The most common reason managers skip them is the fear of what they’ll hear. That’s exactly why they’re so valuable.

For both groups, the goal is not to defend the product or gather testimonials. The goal is to understand the specific moment when the product either clicked or didn’t. Ask churned users: “When did you realize this wasn’t going to work for you?” Ask Power users: “Can you walk me through the last time you used this and what you were trying to get done?”

Do this with ten people in each group. You will hear patterns within the first five conversations. By ten, you will have more actionable insight than most quarterly business reviews produce.

Watch What Customers Do, Not What They Say They’ll Do

One of the most common mistakes managers make when evaluating product-market fit is relying on expressed intent rather than observed behavior. Customers will tell you they love the product. They will tell you they’re definitely going to upgrade. They will tell you they’d recommend it to everyone they know.

Then watch what they actually do.

Behavioral signals that suggest strong product-market fit:

• Customers integrate the product into their regular workflow without being prompted
• Usage increases over time without a marketing push
• Customers refer others organically, without a referral program
• Support tickets are about how to do more with the product, not about basic functionality problems
• Customers push back when you suggest removing features

Behavioral signals that suggest you don’t have fit yet:

• High trial-to-paid conversion that doesn’t hold through the second billing cycle
• Customers who say they love it but need repeated nudges to use it
• Usage concentrated in one narrow feature while the rest of the product sits unused
• Customers who refer others but the referrals don’t convert

The gap between what customers say and what they do is where the real diagnosis lives.

Use Your Sales Cycle as a Signal

If your product has a sales motion, the sales cycle itself is a useful proxy for product-market fit. When fit is strong, deals move faster, objections are fewer, and customers close themselves. When fit is weak, every deal requires heroic effort and heavy discounting.

Ask your sales team or review your CRM for these patterns:

• How long does it take from first contact to closed deal for customers who convert easily versus those who require heavy nurturing?
• What objections come up most often? Are they about price, or are they about whether the product actually solves the problem?
• Which customer segments close fastest and churn least? That’s your beachhead.

If your best customers are finding you through word of mouth and closing in a short cycle, that’s a strong signal. If you’re grinding through long sales cycles with heavy customization required to get anyone across the line, the product may not yet be solving the problem well enough on its own.

Define Your Ideal Customer Profile Before You Measure Fit

One reason product-market fit evaluations go wrong is that teams measure fit against the entire customer base rather than against the specific customer the product was designed for. A product can have excellent fit for one segment and terrible fit for another, and if you average across both, you see mediocre numbers that mislead you in both directions.

Before you interpret any of the signals above, get specific about who you’re measuring fit for. Your ideal customer profile should describe:

• The specific role or situation the customer is in
• The problem they have when they first come to you
• The outcome they need to achieve
• The constraints they’re working under (time, budget, technical sophistication)

When you run the 40% survey, filter responses by whether the respondent matches your ICP. When you look at retention, segment by customer type. You may find that your ICP customers are at 55% and everyone else is at 15%. That tells you something very different than a blended 30%.

For managers without a data team, this segmentation doesn’t require sophisticated tooling. A simple tag in your CRM or a column in your spreadsheet is enough to separate the signal from the noise.

Know the Difference Between Fit and Traction

Product-market fit and traction are often confused, and the confusion leads to bad decisions. Traction means your acquisition is working—you are successfully finding customers. Fit means the product is delivering enough value that customers stay and come back.

You can have traction without fit. A strong marketing campaign or a compelling free trial can drive high acquisition numbers while retention remains terrible. This looks like success until you look at the renewal numbers three months later.

You can also have fit without traction. A small, loyal group of customers who love the product but haven’t been able to find more customers like them. This looks like a small business when it might actually be a large business waiting for the right acquisition channel.

As a manager evaluating product-market fit, make sure you’re looking at both sides of the equation. High acquisition with low retention means you have a product problem. Low acquisition with high retention means you have a distribution problem. The fixes are completely different.

Build a Simple Fit Score You Can Track Over Time

You don’t need a sophisticated model to track product-market fit over time. You need a small set of indicators that you check consistently. Here is a simple framework you can build in a spreadsheet:

• Retention at week 8: percentage of users still active
• Very disappointed score: from the Ellis survey, run quarterly
• NPS or CSAT: a simple satisfaction measure, even if imperfect
• Organic referral rate: what percentage of new customers came from word of mouth
• Second purchase or renewal rate: are customers coming back?

Track these monthly. Look for direction of travel more than absolute numbers. A 35% very-disappointed score that is moving toward 40% is more encouraging than a 42% score that is eroding. Trend matters as much as threshold.

What to Do When the Signals Are Mixed

In practice, product-market fit signals are rarely clean. You will often have a high retention rate in one customer segment and a low one in another. You will have strong qualitative feedback from power users and alarming churn from a different cohort. You will see organic referrals in one channel and paid acquisition dependency in another.

Mixed signals don’t mean you can’t make a decision. They mean you need to make a more specific decision. The question isn’t “do we have product-market fit?” The question is “do we have product-market fit with this customer, in this use case, through this acquisition channel?”

Your job as a manager is to narrow the question until the answer becomes clear, and then act on what you find—even when the answer tells you something you’d rather not hear.

The Bottom Line

Evaluating product-market fit without a data science team is not only possible—it often produces clearer insights than over-engineered analytics setups, because it forces you to stay close to customers rather than hiding behind dashboards.

Start with the 40% survey. Look at your retention curve. Talk to the customers who stayed and the ones who left. Watch behavior more than stated preference. Segment by your ideal customer profile before you draw conclusions. And track a small set of indicators consistently over time.

The signals are there. You don’t need a team of analysts to read them. You need the discipline to look, and the honesty to act on what you find.