Interview Scoring & Calibration Rubric

You are an I/O psychologist designing a structured interview evaluation system that reduces bias and improves hiring accuracy.

Create a comprehensive scoring rubric for:

**Role:** {{ROLE_TITLE}}
**Core Competencies:** {{COMPETENCIES}}
**Team Culture:** {{CULTURE}}
**Key Challenges:** {{CHALLENGES}}

**Deliverable: Calibrated Scoring System**

1. **Competency Definitions** (For each core competency)

   **Competency:** {{COMPETENCY_1}}
   - **Definition:** What does this competency actually mean for this role?
   - **Why it matters:** How does this competency drive performance?
   - **Observable behavior at each level:**
     - **Level 1 (Developing):** Early signs of this competency
     - **Level 2 (Competent):** Can handle typical situations
     - **Level 3 (Advanced):** Excels, goes beyond requirements
     - **Level 4 (Expert):** Industry-leading performance

2. **Interview Questions Mapped to Competencies** (Behavioral/Situational)

   **Question 1 (for {{COMPETENCY_1}}):**
   - **Prompt:** "Tell me about a time when..."
   - **Competency Being Assessed:** {{COMPETENCY_1}}
   - **Scoring Anchor Points:**
     - **Score 1:** {{LEVEL_1_EXAMPLE}} (vague, no ownership, no results)
     - **Score 2:** {{LEVEL_2_EXAMPLE}} (reasonable involvement, some specifics)
     - **Score 3:** {{LEVEL_3_EXAMPLE}} (clear ownership, specific actions, measurable results)
     - **Score 4:** {{LEVEL_4_EXAMPLE}} (exceptional thinking, strategic impact, future-focused)
   - **Red Flags:** What answers would disqualify this candidate?
   - **Listen For:** Specific phrases or behaviors that indicate strength

3. **Scoring Guide for Each Question**

   **Question 1: [Behavioral Question]**

   **STRONG (Score 3):**
   ✓ Candidate clearly states the situation and their role
   ✓ Describes specific actions they took
   ✓ Articulates why they chose this approach
   ✓ Shares measurable result or learning
   ✓ Reflects on what they'd do differently with hindsight

   **ADEQUATE (Score 2):**
   ✓ Gives some context but may be unclear about their role
   ✓ Mentions actions but not in great detail
   ✓ Result is mentioned but not quantified
   ✗ May focus on team results without personal contribution

   **WEAK (Score 1):**
   ✗ Vague or hypothetical answer ("I probably would...")
   ✗ Focuses on what the team did, not their contribution
   ✗ No clear result or outcome
   ✗ Can't articulate why they chose that approach
   ✗ Blames external factors

   **RED FLAG (Score 0):**
   ✗ Story shows poor judgment or unethical behavior
   ✗ Dismisses the question or refuses to answer
   ✗ Multiple factual inconsistencies

4. **Overall Assessment Template** (For interviewers to complete after each interview)

   ```
   CANDIDATE: {{NAME}}
   ROLE: {{ROLE}}
   DATE: {{DATE}}
   INTERVIEWER: {{INTERVIEWER}}

   COMPETENCY SCORES:
   {{COMPETENCY_1}}: ___/4   (Observable evidence: ________________)
   {{COMPETENCY_2}}: ___/4   (Observable evidence: ________________)
   {{COMPETENCY_3}}: ___/4   (Observable evidence: ________________)
   {{COMPETENCY_4}}: ___/4   (Observable evidence: ________________)

   OVERALL IMPRESSION (Gut check): Strong / Moderate / Weak
   (Why does your gut say this?)

   CONCERNS: ________________
   HIGHLIGHTS: ________________
   RECOMMENDATION: Advance / Hold / Reject
   ```

5. **Calibration Conversation Guide** (For hiring team debrief)

   **Before discussing candidates:**
   - Each interviewer scores independently (no discussion)
   - Scoring is blind (no bias from "that person seemed nice")

   **Discussion prompts:**
   - "What specific behavior did you observe for {{COMPETENCY}}?"
   - "What made you give a 3 instead of a 2?"
   - "Did you notice anything that concerned you about [red flag]?"
   - "How does this candidate compare to your reference candidate?" (anchor to a known strong hire)

6. **Bias-Reduction Checklist**

   ✓ Evaluate based on competencies, not gut feeling
   ✓ Ask the same questions to every candidate
   ✓ Score independently before discussing
   ✓ Reference specific behavioral examples, not impressions
   ✓ Compare candidates to role requirements, not to each other
   ✗ Don't score based on: personality, hobbies, demographics, school prestige alone
   ✗ Don't let first impression anchor all subsequent judgments
   ✗ Don't conflate "similar to me" with "right for the role"

7. **Decision Framework**

   **Offer Decision:**
   - Average score ≥ 3 across all competencies
   - No red flags
   - Multiple interviewers agree on strength

   **Hold Decision:**
   - Inconsistent scoring (some interviewers 3, others 2)
   - One critical competency scored 1 or 2
   - Need more reference check / technical assessment

   **Reject Decision:**
   - Any red flags observed
   - Average score ≤ 2
   - Consistently weak on must-have competencies