Methodology

A score you can inspect, compare, and defend.

EvalLense does not ask one model for a final verdict. It turns each deck into evidence, routes that evidence through fixed criteria and independent judge lenses, computes an advisory AI Total Score, and keeps the final ranking under human control.

Review at scale

Human review does not scale cleanly

At small volume, reviewers can still read carefully. At large volume, consistency starts to crack. Different reviewers anchor on different signals, and strong submissions disappear in the pile. EvalLense keeps review structured when the batch is too large for unaided human review.

RiskReviewers focus on different signals
System response

Fixed P1-P6 dimensions

RiskScores are hard to defend
System response

Score trace

RiskStrong submissions get lost in the pile
System response

Structured review queue

RiskAI can overreach
System response

Jury Score controls the ranking

Field tested

The method earned its shape through iteration

  • 400+Evaluation runs behind the current methodBuilder log
  • 6Judge lenses with defined rolesPitch preset
  • P1-P6Fixed dimensions for every deckDimension matrix
Method foundations

Built from startup evaluation methods, not prompt tricks

The Pitch Competition dimension matrix combines three established startup-evaluation lenses. It is thesis-first: a polished deck should not score high if the problem is vague, the customer is unclear, and the business logic is thin. Presentation quality matters, but it is not the whole method — a polished deck should not outrank weak problem, market, team, or feasibility evidence.

  • Feeds P1 · P2

    Lean Startup

    Hypothesis and problem-solution logic — feeds Problem significance and Solution differentiation.

    Glass illustration: a Lean Startup book beside Hypothesis and Customer Pain cards and a Validated check token
  • Feeds P1 · P2

    Customer Development

    Customer, pain, and validation evidence — feeds Problem significance and Solution differentiation.

  • Feeds P3 · P5 · P6

    VC Due Diligence

    Market, business model, team, and feasibility — feeds Market, Team, and Feasibility.

One fixed path

Every deckfollows the same path

The process stays fixed, so every deck is reviewed the same way.

  1. 01DecoderPDF, PPTX, or Google Slides — every deck is converted into the same structured, slide-by-slide format for the judges.
  2. 02AI JudgesSix judges review the deck independently against the same criteria. They don't see one another's scores.
  3. 03AggregateThe scoring layer aggregates judge scores with fixed math. A separate summary layer prepares the narrative and follow-up questions.
  4. 04ScoringYour criterion weights are applied to the Human Jury Score to produce the Final Score.
  5. 05ReportAn explainable report is assembled for every participant.
Controlled influence

Not every judge influences every score

The matrix shows how much each judge lens (J-P1...J-P6) contributes to each dimension (P1-P6). Primary judges drive the score. Secondary judges add important support. Advisory judges provide context. None means no scoring influence.

Primary1.00Secondary0.50Advisory0.25
Judge routing matrix: each judge scored against each dimension, marked primary, secondary, advisory, or not scored.
JudgeProblemSolutionMarketGTMTeamFeasibility
Problem significance: PrimarySolution differentiation: AdvisoryMarket attractiveness: AdvisoryBusiness model / GTM: Not scoredTeam / founder fit: Not scoredFeasibility / readiness: Advisory
Problem significance: SecondarySolution differentiation: PrimaryMarket attractiveness: AdvisoryBusiness model / GTM: AdvisoryTeam / founder fit: Not scoredFeasibility / readiness: Secondary
Problem significance: AdvisorySolution differentiation: AdvisoryMarket attractiveness: PrimaryBusiness model / GTM: PrimaryTeam / founder fit: Not scoredFeasibility / readiness: Advisory
Problem significance: AdvisorySolution differentiation: AdvisoryMarket attractiveness: AdvisoryBusiness model / GTM: AdvisoryTeam / founder fit: AdvisoryFeasibility / readiness: Advisory
Problem significance: Not scoredSolution differentiation: Not scoredMarket attractiveness: AdvisoryBusiness model / GTM: AdvisoryTeam / founder fit: PrimaryFeasibility / readiness: Secondary
Problem significance: AdvisorySolution differentiation: SecondaryMarket attractiveness: SecondaryBusiness model / GTM: SecondaryTeam / founder fit: SecondaryFeasibility / readiness: Primary
Score trace

Evidence before score

A number is useful only when you can inspect the evidence behind it. The rubric forces evidence, strengths, weaknesses, and missing information before a score — never the other way around. Worked example, P3 Market: evidence on slides 6 and 8, strength a clear target segment, weakness an unsourced TAM, missing buyer validation, confidence medium — which lands the score in the band, not above it.

  • Cite the evidence

    Use slide-grounded facts only. Every claim must point to a specific slide.

  • Weigh it both ways

    State what supports the score, what lowers it, and what the deck leaves unclear or unproven.

  • Name the band

    Explain which rubric band the evidence falls into and why.

  • Then the score

    The score must sit inside that band. At the boundary, incomplete evidence pushes the result down, not up.

The scoring model

How the advisory score is built

A fixed calculation combines judge outputs into an advisory AI Total Score. The same judge scores, routing weights, confidence values, and criterion weights produce the same result. The score informs human review but does not determine the final ranking.

  • Criterion score

    Per dimension

    Judge scores are combined using routing weights to produce a weighted average. Inputs Judge score · routing weight · confidence Primary judges Carry the strongest influence Advisory judges Add context without dominating the score

    Judges, weighted by their routing role, combine into one confidence-adjusted AI Criterion Score; disagreement is shown separately
  • Confidence

    Confidence adjustment

    Confidence is calculated separately and can apply a limited downward adjustment. It reduces overconfidence when evidence is thin. Maximum adjustment: 15%.

    A criterion score nudged down by a limited confidence adjustment when evidence is thin
  • Total score

    Across dimensions

    Project weights combine the AI Criterion Scores into one advisory AI Total Score on a 0-10 scale.

    Six AI Criterion Scores orbiting and combining into one advisory AI Total Score
  • Review signal

    Disagreement

    Spread flags consensus, split, or conflict between primary and secondary judges. It does not change the score — it tells reviewers where to look closer.

  • Reproducible math

    Reproducible

    No model call runs during final aggregation. The same judge outputs and weights produce the same calculated score every time.

Review signals

Averages can hide the case that needs review

When judges disagree, EvalLense shows the spread instead of burying it in an average. Spread does not change the score. It points reviewers to the cases that need a closer look. The numeric tests live in Consistency & Reliability.

SignalHigh score · low spread
Meaning

Strong, stable signal

SignalHigh score · high spread
Meaning

Strong score, needs review

SignalMarket strong · feasibility weak
Meaning

Opportunity with execution risk

SignalLow score · high spread
Meaning

Contested, not simply weak

Human control

AI prepares the evidence. You set the score.

The AI Total Score is an advisory baseline - it explains the AI read, but it never ranks the batch. The Jury Score is the final human scoring input, and the leaderboard is ranked only by that human score. Because no model runs at scoring time, the same judge outputs and weights reproduce the same baseline every time.

  • Review the evidence

    AI suggests a score for each dimension and shows the evidence behind it — a read-only reference.

  • Add live context

    Bring in what the deck can't show: notes from the live pitch and the Q&A.

  • Set the Jury Score

    You set your own Jury Score per dimension. It stays a separate value from the AI Criterion Score — the AI baseline for one dimension.

  • Submit the decision

    The leaderboard is built only from submitted Jury Scores. The AI Total Score never determines the ranking.

Clear boundaries

Prepares the review, never your judgment

EvalLense evaluates what is present in the deck, highlights missing evidence, and prepares the review. It does not prove that every claim is true.

It is notAn external truth check
What it does

Evaluates what the deck presents and flags what is missing — it does not verify claims against the outside world.

It is notInvestment advice
What it does

Gives decision support for reviewers, not a recommendation to fund or pass.

It is notAutomatic winner selection
What it does

Never ranks the batch — the human Jury Score owns the leaderboard.

It is notA prediction of success
What it does

Describes the pitch today; it does not forecast whether the startup will succeed.

Follow one score from slide to final call

Open a sample evaluation and trace one score from slide evidence to rubric band, judge output, AI Total Score, and final Jury Score.