Designing award scoring rubrics that survive scrutiny
An awards programme is only as credible as its rubric. Five rules for one that holds up when a losing nominee asks how the decision was made.
Every awards programme eventually receives the email: on what basis was this decided? The answer needs to exist before the question is asked.
Publish the weights before nominations open
Criteria published after submissions close are indistinguishable from criteria written to fit a result. Weights go out with the call.
Anchor every score point
"Innovation: 1–5" means five different things to five judges. "4 — introduces a method not previously used in this sector, with evidence of adoption" means one thing. Behavioural anchors are the single highest-leverage change you can make.
Use an odd number of judges
Three or five per nomination. Even panels deadlock, and a deadlock resolved by the chair is a decision nobody wants to defend in writing.
Write the conflict rule down
Same organisation, same institution, direct commercial relationship, previous supervision. Declared at panel formation, enforced at assignment, recorded either way.
Moderate outliers, and record it
When scores for one nomination span the full range, that is a signal about the rubric, not just the nomination. A short moderation step — with its outcome recorded — turns a dispute into a decision.
ORBIT Award enforces each of these and keeps the full scoring trail against every nomination. See how award management works in ORBIT.