← Back to blog
·10 min read
Written by:
MI
Morgan Ito
Verified by:
CL
Casey Lin

Startup Idea Validation Scorecard (Reddit Evidence)

A weighted startup idea validation scorecard with Reddit evidence: six criteria, a worked hypothetical example and clear go, refine or stop thresholds.

Share:

Key Takeaways

  • This scorecard rates an idea on six weighted criteria, each scored from 0 to 5 using evidence you can link to.
  • Willingness-to-pay signals and problem severity carry the heaviest weights, because a frequent but harmless annoyance rarely supports a business.
  • A weighted total of 70 or more suggests go, 50 to 69 means refine, and below 50 means stop or rethink.
  • Reddit evidence can support four of the six criteria well, but it is weak on market size and on real purchase intent.
  • The scorecard guides a decision and does not predict success, so run it again after interviews or a small test.

Quick answer: A startup idea validation scorecard rates an idea from 0 to 5 on six weighted criteria, then converts the result to a score out of 100 with thresholds for go, refine or stop. This version uses Reddit as the evidence source where it is strong, and flags where it is not.

It is a decision aid, not a prediction. The numbers are only as good as the evidence behind each one, so every score below asks for a link, a quote or a count.

Scorecard vs Checklist vs Mistakes List

You may already have read our SaaS idea validation checklist or niche validation checklist. Those ask whether you have covered the checks. This page does something different: it weighs the evidence and gives you a number you can compare across ideas.

ToolBest forOutput
SaaS idea validation checklistMaking sure no check is skippedDone or not done
Niche validation checklistJudging a market areaDone or not done
Idea validation mistakesSpotting false confidenceErrors to avoid
This scorecardRanking and comparing ideasWeighted score and a decision

If you want to check the research process behind your scores, use the Reddit research checklist.

The Six Criteria and Their Weights

The weights below are a starting point, not a law. Change them for your situation, but set them before you score, so you are not tuning them to rescue a favorite idea.

CriterionWeightWhat you are asking
Problem frequency15How often does the problem come up?
Problem severity20How much does it hurt when it does?
Current workaround cost15What do people spend in time or money today?
Willingness-to-pay signals25Is there evidence people pay to solve it?
Competition and gaps10Are existing solutions failing in a specific way?
Reachability15Can you actually reach these people?

The scoring formula is: for each criterion, score 0 to 5, divide by 5, multiply by the weight, and add. A perfect score is 100.

Willingness to pay and severity get the most weight on purpose. A problem can be frequent and trivial, like a mildly annoying menu. People mention it, and nobody pays to fix it.

How to Score Each Criterion With Reddit Evidence

Use this scale for every criterion: 0 is no evidence, 1 is a hint, 3 is a clear pattern across several sources, 5 is a strong, repeated pattern across independent sources and communities.

1. Problem frequency (weight 15)

Reddit evidence: Count separate threads, from different accounts, describing the same problem over a defined period. Tally recurring questions across communities.

Caveat: Reddit shows how often something is posted, not how common it is in the real world. A frequently posted problem is a lead, not a market measurement.

For method detail, see how to find pain points on Reddit.

2. Problem severity (weight 20)

Reddit evidence: Look at the language. Time lost, money lost, deadlines missed, jobs at risk, and words like "stuck" or "nightmare" suggest high severity. "It's a bit annoying" suggests low.

Caveat: Strong language can be a personality, not a pain level. Look for consequences, not adjectives. The how to prioritize pain points guide separates severity from frequency in detail.

3. Current workaround cost (weight 15)

Reddit evidence: People describe what they do now: spreadsheets, manual steps, paid agencies, multiple tools stitched together. The more effort or cash the workaround eats, the higher the score.

Caveat: A workaround proves effort today, not that people want to give it up. The jobs-to-be-done framework helps you see what the workaround is hired to do.

4. Willingness-to-pay signals (weight 25)

Reddit evidence: Reddit gives indirect signals only. Examples include people asking for recommendations on paid tools, discussing prices they pay or refuse to pay, complaining about a subscription while staying on it, or hiring freelancers for the task.

Caveat: This is the weakest area for Reddit. Talking about price is not paying a price. Cap this score at 3 until you have direct evidence, such as interviews, a pre-sale or a deposit. Our customer discovery guide covers how to get it.

5. Competition and gaps (weight 10)

Reddit evidence: Complaints about named competitors, "alternative to" threads and switching stories show where existing products fall short. Some competition is a good sign, because it shows demand exists.

Caveat: An empty field might mean no demand. A crowded field with a repeated, specific complaint is often the better score. The market gap analysis framework and how to research competitors on Reddit go deeper.

6. Reachability (weight 15)

Reddit evidence: Are the people concentrated in communities you can join and participate in honestly? Active, focused subreddits are a good sign, though many forbid promotion.

Caveat: Being able to read a community is not the same as being able to acquire customers there. Check each community's rules, and see startup distribution channels for options beyond Reddit.

Worked Example (Hypothetical)

The following is a made-up example to show the arithmetic. The idea, the evidence and the scores are all invented for illustration and do not come from real research.

Hypothetical idea: A tool that turns messy client feedback emails into a clean revision list for freelance designers.

CriterionWeightHypothetical score (0-5)Hypothetical evidence notePoints
Problem frequency154Assume the problem shows up in many separate threads across two communities12.0
Problem severity203Assume lost hours and scope creep, but few mentions of lost clients12.0
Workaround cost153Assume people use spreadsheets and notes apps9.0
Willingness to pay252Assume only indirect signals, so capped low10.0
Competition and gaps104Assume recurring complaints about project tools being too heavy8.0
Reachability153Assume a few relevant communities with mixed promotion rules9.0
Total10060.0

Result under the thresholds below: refine. The lowest-scoring, highest-weight criterion is willingness to pay, so the next step is not more reading. It is five to ten conversations with freelance designers about what they pay now, and whether they would pay for this. If those conversations go well, willingness to pay may rise to a 4, which adds 8 points and moves the total to 68, still in refine. Another point of severity evidence would tip it over 70.

That is how a scorecard earns its keep. It tells you where to look next.

Thresholds: Go, Refine or Stop

TotalDecisionWhat it means
70 to 100GoRun a small, real test: a landing page, a pre-sale, a prototype or a paid pilot
50 to 69RefineFind out which low score is fixable with more evidence, or narrow the idea
Below 50Stop or rethinkDrop it, or change the customer or the problem

Two override rules are worth adding.

  • Floor rule: If willingness to pay or severity scores 1 or lower, do not go, whatever the total says.
  • Evidence rule: Scores built on fewer than a handful of sources should be marked low confidence and rechecked.

These thresholds are our suggestions, not an industry standard. Set yours before scoring and write them down.

Collecting the Reddit Evidence

You can gather evidence by hand with the methods in Reddit research methods and record it with the pain point research template. A tool can speed up the first pass. PainPointMap scans subreddits you choose, extracts and ranks pain points with quotes and links to source threads, and scores severity and frequency, so it maps directly to the first two criteria and helps with competition on the Professional plan. It does not measure willingness to pay or reachability, and you should open the source threads to verify what it surfaces.

Starter is $19/month (10 scans a day, 2 subreddits per scan). Professional is $49/month (15 scans a day, 5 subreddits per scan, plus competitor mapping, gap analysis and PDF reports). There is no free plan, only a 3-day free trial with a card required. For other options, see best Reddit research tools.

Caveats You Should Not Skip

  • Reddit is not a random sample. Users self-select and post when something goes wrong.
  • Scores are subjective. Two people will score the same evidence differently. Have a second person score independently, then compare.
  • Weights shape the result. If your favorite idea only passes under your favorite weights, treat that as a signal.
  • The scorecard compares, it does not predict. A high score means the evidence looks better than the alternatives, not that the idea will work.
  • Evidence ages. Rescore after interviews, tests or any major market change. The how much validation is enough article helps you decide when to stop.

Using the Scorecard to Compare Several Ideas

The biggest advantage appears when you score three to five ideas with the same criteria and weights. Put them in one table and sort by total. Then look at the pattern, not only the winner.

An idea with a high total but a low willingness-to-pay score needs direct testing. An idea with a middling total but strong severity and a clear gap may deserve a narrower version. For idea sources, see startup ideas from Reddit and micro SaaS ideas for 2026.

Final Thoughts

A scorecard will not tell you what to build. It forces you to say what evidence you have, how strong it is, and where the gaps are. The honest low scores are the most useful part.

Score your idea once with the evidence you have today, then spend your next week on the lowest weighted score. If gathering Reddit evidence is the slow part, PainPointMap can do the first pass across subreddits. Start your 3-day free trial (card required, then $19/month for Starter or $49/month for Professional unless you cancel).

More walkthroughs are in the Reddit research guides hub, and the niche ideas by platform hub shows where to apply them. The idea validation framework shows how to run the test that follows a "go".

More Reddit Research Guides

Frequently Asked Questions

How do you score a startup idea?

Rate it from 0 to 5 on each of several criteria, such as problem frequency, severity, workaround cost, willingness to pay, competition and reachability. Multiply each score by its weight, add the results and compare the total to thresholds you set in advance. Each score should point to evidence, such as a linked thread or an interview note.

What is a good score for idea validation?

There is no universal passing mark, so set your own thresholds before scoring. In this scorecard, 70 or more out of 100 suggests moving to a real test, 50 to 69 means gather more evidence, and below 50 means stop or change the idea. Treat the number as a prompt for discussion, not a verdict.

Can Reddit evidence validate a startup idea?

Reddit evidence can show that a problem exists, how people describe it and what they do today. It cannot prove people will pay or measure market size. Use it to score problem frequency, severity, workarounds and competition, then confirm willingness to pay with interviews, a pre-sale or another direct test.

How is a scorecard different from a validation checklist?

A checklist asks whether you have done certain checks. A scorecard weighs how strong the evidence is and produces a comparable number. That makes a scorecard useful for ranking several ideas against each other, while a checklist is better for making sure no step was skipped.

How often should I rescore an idea?

Rescore whenever you get meaningful new evidence, such as after customer interviews, a landing page test, or a new batch of research. Keep each version of the scorecard with a date so you can see which scores moved and why. Scores that only go up with no new evidence are a warning sign.

Validate the idea before you build it.

Get real pain point data from the communities your users are already in. Know whether the problem is real before you write a line of code.

Validate My Idea: 3-Day Trial
MI
Morgan Ito
Data & Research, PainPointMap

Runs the original data and analysis pieces on the blog, scanning Reddit communities at scale to surface patterns in what founders and operators actually struggle with.