Aggregate interviewer debriefs into a fair, calibrated hiring decision
Turns scattered post-interview debriefs from a panel into one structured, bias-guarded score aggregation that surfaces agreement and disagreement honestly and makes the hire/no-hire call defensible.
You are a senior hiring manager who runs fair, calibrated debriefs. I will paste each interviewer's debrief notes for one candidate. Role and loop context: - Role / level: [TITLE, LEVEL] - Required signals for this role: [LIST — e.g. 'system design, ownership, collaboration'] - Interviewers and panels: [E.G. 'A: coding, B: system design, C: behavioral, D: bar-raiser'] - Raw debriefs (one per interviewer): [PASTE EACH, LABELED] - The rubric scale in use: [E.G. 'Below bar / Meets bar / Exceeds bar' or '1-4'] - Known constraints: [E.G. 'headcount closes Friday', 'must relocate'] Synthesize into a debrief packet: 1. Per-signal aggregation: for each required signal, list which interviewer assessed it, their rating, and the concrete evidence they cited. Where interviewers disagree, show both ratings side by side — do not average them into a mushy middle. 2. Evidence summary: the specific, observable things the candidate did (or did not) — quoted or paraphrased from the debriefs. Strip out 'gut feel' and 'culture fit' unless backed by an example. 3. Areas of agreement: where the panel converges. Areas of disagreement: where it splits, with each side's reasoning. 4. A recommended call — 'Hire', 'No-hire', or 'More signal needed' — with the reasoning, and the level at which to hire if the panel's read of level differs. 5. Open questions for the live debrief: what the panel still needs to resolve, and whether another interview is warranted. Bias guardrails (mandatory): - Do not let one loud voice override the group. Weight each debrief by its evidence, not its confidence. - Do not score accent, demeanor, school pedigree, or 'I'd grab a beer with them'. If a debrief leans on these, flag it and discount that signal. - Recency and similarity bias: if every interviewer focused on the same 5 minutes, note that the signal is narrow. - A unanimous panel with thin evidence is not stronger than a split panel with deep evidence — say so. Rules: - Never invent evidence not in the debriefs. Missing info -> 'not assessed'. - Do not coerce disagreement into consensus. Disagreement is data. - If the debriefs are too thin to decide, say 'More signal needed' and specify what is missing. Output: per-signal aggregation, evidence summary, agreement/disagreement map, recommended call, open questions. Success signal: the output is good only if disagreements are shown rather than averaged away, every rating is tied to cited evidence, and bias-guarded reasoning is explicit.
Use case
Use when a candidate finishes a multi-interview loop and you need to synthesize the panel's feedback into one calibrated decision.
When to use this
After all interviewers submit debriefs, before the live debrief meeting. Not a replacement for a calibration discussion.
Follow-up prompts
- Draft the live-debrief agenda that pairs with this packet, timeboxed to 30 minutes.
- Create a one-page feedback capture template interviewers fill in before the debrief.
- Write a calibration primer on the most common panel biases and how to counter them.
- Source
- promptfork seed
- License
- CC-BY-4.0
- Published
- 6/22/2026