Skip to content

Structured interview feedback that compares fairly

How to write structured interview feedback that compares candidates on the same things: a scorecard per role, scores before the debrief, notes as evidence.

6 min read

The HRMS mark beside the words "Interview feedback that compares like with like".

Most hiring debriefs go the same way. Three interviewers met the candidate, one of them talks first and with conviction, and the other two adjust what they remember to fit. The feedback in the system says “strong communicator, good energy” for one candidate and “solid on fundamentals” for the next, so nobody can say which of the two was better at the thing the job actually needs.

Structured interview feedback is the cure, and it is less bureaucratic than it sounds. Decide before the first interview what you are judging, score every candidate on exactly those things, and write the scores down before anyone compares notes. This post sets out how to do that for a small team, with a scorecard you can adapt, and how Orbiz HRMS supports it.

What makes interview feedback structured

The US Office of Personnel Management, which writes assessment guidance for the federal workforce, describes structured interviews as ones that use rules for eliciting, observing and evaluating answers. At the most structured end, every candidate is asked the same questions and scored against benchmarks of proficiency. Its summary of the research is that more structure brings higher validity, better agreement between interviewers and less adverse impact, because each interviewer has less room for a general impression to stand in for a judgement.

You do not need a federal process to get most of the benefit. Three habits do the work:

  1. The same areas for every candidate in a round, chosen from what the job needs, not from what the interviewer enjoys asking about.
  2. A score per area, not one overall verdict, so a strong answer in one place cannot hide a weak one elsewhere.
  3. Scores written before the debrief, independently. OPM notes that structured interviews are usually scored by a panel in which each member rates the answers on their own and then discusses large differences.

Build the scorecard before the first interview

Write the scorecard when you write the job post. List four to six areas that separate a good hire from an average one in this role, and give each a maximum score that reflects how much it matters. Weighting by maximum score is simpler than percentages: an area out of 25 counts two and a half times an area out of 10, and every interviewer can see that at a glance.

AreaMaxWhat a top score looks like
Problem solving25Breaks the problem down unprompted and tests their own answer
Technical depth25Explains the trade-offs of their choices, not just the choice
Code quality20Readable code, sensible names, thinks about failure cases
Communication15Says what they are doing and asks when the brief is unclear
Collaboration15Gives specific examples of working through disagreement

That example is for a backend engineer; a designer or an account manager needs different areas. Two rules hold whatever the role. Avoid “culture fit” as an area, because it tends to measure similarity to the interviewer; name the behaviour you actually want, such as collaboration or ownership. And write one line on what a top score looks like, so that “20 out of 25” means the same thing from every interviewer.

Write feedback that a stranger could check

A score without a note is an opinion. A note without evidence is an adjective. Good structured feedback gives each score a sentence about what the candidate said or did:

  • Weak: “Great problem solver.”
  • Better: “Split the rate-limiter question into storage and policy before writing code; caught the clock-skew issue themselves.”
  • Weak: “Not a culture fit.”
  • Better: “When asked about a disagreement with a reviewer, described going over their head twice; no example of resolving it directly.”

Write about the candidate, never in comparison with other candidates, and never about things the job does not need: accent, age, where they studied. Score straight after the interview, while you remember the detail, and before you read anyone else’s feedback.

Compare candidates area by area, not total by total

Once every interviewer has scored the same areas, comparison becomes a reading exercise rather than an argument. Look at three things. First, the area scores side by side: two candidates on 78% overall may be strong in completely different places, and only one of those places may matter for this team. Second, the spread between interviewers on the same area: a 22 and a 9 on problem solving means they saw different things, and that is the conversation to have in the debrief. Third, percentages across rounds: if the phone screen and the technical round use different scorecards, compare percentages rather than raw points.

How Orbiz HRMS handles interview feedback

In HRMS, the scorecard is a feedback form: a title, an optional description of what it evaluates, and a list of evaluation areas, each with a whole-number maximum score. Forms can be marked active or inactive, so last year’s scorecard stays on record without being offered for new interviews. One form per role, or per round, is the usual set-up.

When HR schedules an interview, they pick the round type, the interviewers (one can be marked as lead), the meeting type, whether on site, by phone, over a pasted video link or on Google Meet, and the feedback form the interviewers will score. Attaching a form is optional at scheduling, but there is no scorecard without one, so HR adds it from the interview’s edit or reschedule action before feedback is due. Each interviewer sees the interviews they owe feedback on in a Pending Feedback list, and completing an interview opens the scorecard straight away.

The scorecard shows each area with its maximum, a score box and an optional note, and adds up the obtained score, the maximum and the percentage as the interviewer types. It will not submit until every area has a score between 0 and that area’s maximum. Interviewers can update their own feedback later.

On the candidate’s profile, the Scorecard tab brings the interview feedback together: one entry per round and interviewer, with the score out of the maximum, the percentage and, when opened, every area’s score and note. Assessment results sit on the candidate too, and AI screening, if you switch it on for the job, is shown as its own score, separate from what your interviewers wrote. Who can read submitted feedback follows the roles you set up in Orbiz.

What HRMS does not do here

An evaluation area in HRMS has a name and a maximum score. It has no built-in field for the “what a top score looks like” anchor, so put those lines in the form’s description or in the interviewer brief. There is no bank of interview questions; the question bank in HRMS is for written assessments. And HRMS does not source candidates from job boards: it starts once someone applies through your careers page or is added by your team.

A checklist for your next hire

  • Choose four to six areas from the job, with a maximum score for each.
  • Write one line per area on what a top score looks like.
  • Attach the scorecard to every interview before it happens.
  • Score every area, with a note of evidence, straight after the interview.
  • Submit before reading anyone else’s feedback.
  • Open the debrief with the areas where scores differ most.

Sources, read 4 October 2026: the US Office of Personnel Management’s guidance on structured interviews. Founders hiring their first team can see how hiring fits the rest of the platform on the startups page; for choosing an HR system in Pakistan, see the best HR software in Pakistan.

FAQ

Questions this post gets asked

What is structured interview feedback?

Feedback in which every interviewer scores the same predefined areas for every candidate, gives each score a note of evidence, and records it before discussing the candidate with anyone else. It makes candidates comparable on what the job needs rather than on overall impressions.

What should an interview scorecard include?

Four to six areas drawn from the job, a maximum score for each that reflects how much it matters, a line describing what a top score looks like, and room for a short evidence note per area. Keep "culture fit" out and name the behaviour you want instead.

Should interviewers see each other’s feedback before submitting?

No. Score independently first, then discuss. Reading a colleague’s feedback beforehand pulls your scores towards theirs, which removes the point of having several interviewers. Start the debrief with the areas where the scores differ most.

Does Orbiz HRMS have interview scorecards?

Yes. HR builds feedback forms with evaluation areas and maximum scores and attaches one to each interview. Interviewers score every area with optional notes, and the candidate’s Scorecard tab shows each round’s feedback by interviewer, with area scores and the percentage.

Keep reading

All posts
  • The HRMS mark beside the words "Forty new starters in a week".
    HiringGuidesAttendance

    Seasonal staff onboarding: 40 starters in a week

    A day-by-day plan for onboarding seasonal staff: contracts, documents, checklists, attendance and training for forty starters, and a clean exit at season end.

    Zain Khalid Malik · · 6 min read
  • The HRMS mark beside the words "AI HR software in the UAE, read closely".
    AI assistantsHiringGuides

    AI HR software in the UAE: what to check first

    What AI means in UAE HR software: built-in screening, or your own assistant connected to the system. Plus the WPS, MOHRE and gratuity checks that come first.

    Zohaib Khalid · · 9 min read
  • The HRMS mark beside the words "HR software that works with your assistant".
    AI assistantsHiringGuides

    Which HR software works with Claude and ChatGPT?

    Seven HR systems checked for a Claude or ChatGPT connector: who can connect, what the assistant may change, and what to ask before you switch it on.

    Zohaib Khalid · · 4 min read

Want to see this working in your organisation?

Every tool in this post is included in every plan. Tell us your team size and we set up a working organisation for you to try.