Decide from buyers, not commenters: weighting feedback by receipts

A comment arrives at twenty past seven in the morning. Your course should really cover the advanced stuff, and honestly the price is a bit steep. By lunchtime you have rewritten the module list in your head and talked yourself down by twenty pounds. You have not checked one thing: whether that person has ever bought anything from you.

Attention is cheap. A purchase costs something.

Leaving a comment takes four seconds and costs nothing. Buying takes a card, an email address and the small private moment where someone decides you are worth it. Those two acts produce very different information, and only one of them tells you what a person will actually do when the checkout page is in front of them.

This is genuinely hard, and not because the answer is complicated. It is hard because comments arrive with feelings attached. A stranger calling your work overpriced lands somewhere behind the ribs, and the reflex is to make the complaint go away. A quiet buyer who paid, used the thing and never wrote to you produces no feeling at all. So the feedback you act on is sorted by emotional volume rather than by evidence.

The honest complication is that buyers are not always right either. They tell you what they already have words for. They rarely say "the second lesson dragged", they say "loved it, thanks". Purchase history does not hand you a roadmap. What it does is stop you rebuilding your best product for someone who was never going to buy it.

The question is not whether the criticism is fair. The question is what the person did next.

What you are usually deciding on

Most creators run on a feed. Whatever surfaced today is the evidence, and last month's evidence has scrolled away. A customer list and per-product analytics change what is in front of you when a decision comes up.

Ten minutes with a piece of feedback

You do not need a research process. You need a short habit that runs before you touch the product. Do this the next time a comment makes you want to change something.

1. 1Write the request down in one sentence, in their words, not your interpretation of them.
2. 2Open Customers in your store.fan dashboard and search the name or the email address they use publicly.
3. 3Note what you find: a paying customer, a member, someone who took a free lead magnet, or nobody at all.
4. 4Open Analytics and look at the product they mentioned. Compare views with buyers for the last thirty days.
5. 5If views are high and buyers are low, the page or the price is doing the work. If views are low, the problem is upstream and no product change will fix it.
6. 6Check whether anyone who actually bought has asked for the same thing. One buyer asking beats twenty strangers asking.
7. 7Decide, and write the reason next to the decision so that next month you can tell whether you were right.

What this looks like on a real week

Suppose you sell a £29 workbook. Three people have told you publicly that it should be a full course, and one of them was quite firm about it. You open Analytics: the workbook page took about 1,100 views in thirty days and 26 people bought. You open Customers and search all three names. None of them appears. You search the last ten buyers instead, and two of them have bought from you twice.

That is not a mandate to build a course. It is a page converting at a perfectly ordinary rate, with a small group of repeat buyers who never asked for more content. The useful move is to email those twenty-six people and ask what they did with the workbook, because their answers come with a receipt. Your numbers will look nothing like these, which is the point: they are your numbers, and until you look at them the loudest reply wins by default.

The mistake most people make

The common error is not listening to strangers. It is treating silence as approval. Buyers who are quietly disappointed almost never write to you, they simply do not come back, and that shows up as a flat month rather than a complaint. If you only ever weigh the feedback that arrives unprompted, you will hear from the people who want something free and never from the people who paid and drifted. Ask your buyers directly. You have their email addresses, on every plan including Free, and export is never locked behind an upgrade.

None of this requires a bigger audience or a better temperament. It requires the two-minute pause between reading a comment and opening the product editor, and something to look at during that pause. The people who paid are already on your list. Ask them first.