--- name: interview-kit-builder description: "TRIGGER THIS when preparing interviews, planning hiring processes, creating interview questions, building evaluation frameworks, developing interviewer guides, or standardizing interview approaches. Builds complete interview kits with competency-based questions, scorecards, rubrics, interviewer training, and structured evaluation protocols." --- # Interview Kit Builder ## Overview This skill helps create comprehensive, structured interview kits that enable fair, consistent, and legally sound hiring processes. It provides competency-based questions aligned to job requirements, evaluation scorecards with clear rubrics, interviewer guides, and best practices for structured interviewing that reduces bias and improves hiring outcomes. ## When to Use This Skill - Creating interview processes for a new role - Standardizing interview approaches across the company - Building interviewer training materials - Developing competency-based evaluation frameworks - Creating interview scorecards and rubrics - Preparing structured behavioral and technical questions - Ensuring interview consistency and reducing bias - Training hiring managers on effective interviewing ## Key Components ### 1. Competency Framework Define 4-6 core competencies aligned to job success: **Example Framework for Product Manager Role:** - **Strategic Thinking**: Ability to define vision, set priorities, and align cross-functional teams - **User-Centric Product Sense**: Understanding customer needs and translating into products - **Analytical Problem-Solving**: Data-driven decision making and quantitative thinking - **Stakeholder Influence**: Ability to persuade, negotiate, and build alignment without authority - **Execution & Shipping**: Getting products launched and driving measurable impact - **Learning Agility**: Adapting to change, seeking feedback, growing from mistakes Each competency should have: - Clear definition - 2-3 behavioral indicators - Examples of "strong" vs. "developing" performance - Relevant to actual job success (not generic traits) ### 2. Interview Structure A complete interview kit typically includes: **Interview Round 1: Screening (30 minutes)** - Warm-up questions - Role overview and expectations - Initial competency assessment (1-2 questions) - Candidate questions **Interview Round 2: Technical/Role-Specific (60 minutes)** - Deep dive on 2-3 core competencies - Real-world scenario or case study - Technical assessment (if applicable) - Team fit discussion **Interview Round 3: Leadership/Culture (45 minutes)** - Leadership presence and values alignment - Long-term vision and growth - Additional competency depth - Interviewer background (to help candidate assess fit) **Interview Round 4: Executive Conversation (30 minutes)** - Strategic discussion - Company culture and vision - Candidate's long-term goals - Final questions ### 3. Behavioral Questions (STAR Format) Structure questions to elicit stories that reveal competencies: **Question Format**: "Tell me about a time when [situation]. What did you do? What was the result?" **Key Principles**: - Ask about actual past behavior (not hypothetical) - Require specific examples with context - Look for candidate's role and impact (not just team outcomes) - Ask follow-ups to dig into decision-making **Sample Questions by Competency**: **Strategic Thinking**: - "Describe a time you had to deprioritize important work. How did you decide what to cut?" - "Tell me about a strategy you defined that proved wrong. How did you respond?" - "When have you had to align a diverse group of stakeholders around a controversial decision?" **User-Centric Product Sense**: - "Tell me about a product you've built. Walk me through how you identified the customer need." - "Describe a feature you advocated for that the team resisted. How did you approach getting buy-in?" - "When have you discovered a key customer insight through direct research?" **Analytical Problem-Solving**: - "Tell me about a time you used data to overturn a strongly held assumption." - "Describe a complex problem you analyzed. What data did you use? What was the outcome?" - "When have you defined and tracked success metrics? What did you learn?" **Stakeholder Influence**: - "Tell me about a time you had to influence someone without direct authority." - "Describe a difficult negotiation with an engineering partner or cross-functional leader." - "When have you had to get buy-in for an unpopular or risky idea?" **Execution & Shipping**: - "Tell me about a product you shipped. Walk me through the challenges and how you overcame them." - "Describe your biggest failure in shipping a product. What did you learn?" - "When have you had to accelerate a timeline? How did you navigate quality vs. speed?" **Learning Agility**: - "Tell me about a time you had to learn something completely new for a role." - "Describe feedback you received that was hard to hear. How did you respond?" - "When have you changed your mind about something important? What caused the shift?" ### 4. Evaluation Scorecard Create a standardized scorecard for consistent evaluation: ``` INTERVIEW EVALUATION SCORECARD Candidate: _________________ Position: _________________ Date: _________ Interviewer: _________________ Round: _________ COMPETENCY ASSESSMENT 1. Strategic Thinking [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: 2. User-Centric Sense [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: 3. Analytical Thinking [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: 4. Stakeholder Influence [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: 5. Execution & Shipping [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: 6. Learning Agility [ ] Below Expectations [ ] Meets [ ] Exceeds Evidence from interview: Notes: CULTURE & VALUES FIT Values Alignment (explain): Working Style (team feedback): Overall Impression: RECOMMENDATION [ ] Strong Hire - Advance immediately [ ] Hire - Move forward with caution/more interviews [ ] Maybe - Need more data [ ] Pass - Not the right fit Overall Assessment: ____/5 Next Steps: ``` ### 5. Scoring Rubric Define clear criteria for each rating level: **Below Expectations**: - Unable to provide relevant examples - Examples show minimal or negative impact - Limited evidence of competency - Concerning behaviors revealed **Meets Expectations**: - Provides clear examples with good context - Shows competency with positive outcomes - Demonstrates relevant skills at expected level - Aligned with job requirements **Exceeds Expectations**: - Examples show exceptional impact and results - Deep mastery of competency demonstrated - Goes beyond typical role requirements - Sets bar for internal team **Unable to Assess**: - Insufficient examples provided - Question didn't elicit relevant information - Candidate didn't answer the question ### 6. Interview Guide for Interviewers **Pre-Interview (30 minutes before)** - Review candidate resume and background - Review competencies to assess in this round - Identify 3-4 questions you'll ask - Note any red flags to explore - Review company values and culture - Prepare your introduction/context **Interview Opening (5 minutes)** - Greet warmly and build rapport - Introduce yourself and your role - Explain interview format and timing - Clarify what you're assessing - Set candidate at ease ("No trick questions, just want to understand your background") **Question Asking (40 minutes)** - Ask open-ended questions - Use STAR format: "Tell me about a time..." - Wait for full answer before moving on - Take notes on specific examples and quotes - Ask 2-3 follow-up questions per story: - "Why did you approach it that way?" - "What was the business impact?" - "What would you do differently now?" - Don't interrupt or talk too much (aim for 70% candidate, 30% you) **Probing Deeper** - If answer is vague: "That sounds interesting. Can you walk me through a specific example?" - If too much team credit: "What was YOUR role specifically?" - If too quick: "What was going through your mind at that moment?" - If surface-level: "What was the most difficult part of that situation?" **Closing (5 minutes)** - Ask candidate's questions - Share what you learned in conversation (genuine feedback) - Explain next steps - Thank them for their time **Post-Interview (15 minutes)** - Complete scorecard immediately while fresh - Use specific quotes as evidence - Don't rely on gut feel; anchor to competencies - Note patterns across interviewers ### 7. Technical or Role-Specific Assessments **Design Exercise**: - Provide real-world scenario (not trick questions) - Allow 30-60 minutes for depth - Score on: Problem understanding, approach, communication, feasibility - Focus on thinking process, not perfect solution **Case Study**: - Use anonymized internal case or external example - Ask to analyze, recommend actions, think through tradeoffs - Score on: Analytical rigor, data usage, strategic thinking, clarity **Skills Test**: - Role-specific technical assessment (coding, design, writing, analysis) - Should take <60 minutes - Grade blindly without knowing candidate identity - Use consistent rubric **Portfolio Review**: - Have candidate walk through 2-3 key projects - Ask: "What was your role? What would you do differently? What did you learn?" - Look for: Impact, growth, learning, quality of work ### 8. Interviewer Training Train all interviewers on: **Bias Awareness**: - Unconscious bias exists; bias training should be annual - Common biases: affinity bias, anchoring, confirmation bias - Mitigation strategies: structured questions, specific evidence, discussion with diverse panel **Effective Questioning**: - STAR format questions elicit better information - Avoid yes/no questions - Avoid leading questions that suggest answer - Silence is okay; let candidate finish **Active Listening**: - Take notes without being distracted - Clarify what you're hearing - Avoid planning next question while candidate speaks - Look for patterns in examples **Evaluation Standards**: - Use rubric consistently across all candidates - Don't over-index on one interview or question - Consider trajectory and growth, not just current level - Look for patterns, not single data points **Red Flag Behaviors**: - Blaming others for all failures - Lack of accountability - Disrespect toward others - Dishonesty about accomplishments - Poor self-awareness - Unwilling to learn ## Workflow ### Step 1: Define Competencies - Conduct role analysis: What drives success in this role? - List 4-6 competencies (not traits like "intelligent") - Define each with behavioral indicators - Map to job description - Get hiring manager and team input - Finalize competency framework ### Step 2: Create Behavioral Questions - For each competency, create 2-3 STAR questions - Ensure questions ask about real experiences - Test questions with hiring team (do they elicit useful stories?) - Create follow-up question guide - Build question bank (20+ total questions to select from) ### Step 3: Design Interview Structure - Determine number of rounds needed - Assign competencies to each round - Create timeline and logistics - Assign interviewers - Brief each interviewer on their role - Create interview briefs for candidates ### Step 4: Develop Scorecards & Rubrics - Create standardized evaluation form - Define scoring levels clearly - Include space for evidence and notes - Create overall rating framework - Train scorers on application - Pilot with test candidates ### Step 5: Build Interviewer Guides - Create one-page guide per interview round - Include: questions, timing, competencies, logistics - Add best practices and bias mitigation tips - Create candidate welcome materials - Build interviewer training module - Document decision-making process ### Step 6: Finalize & Train - Assemble complete interview kit - Conduct interviewer training session (1 hour minimum) - Practice rounds with interviewers - Gather feedback and refine - Document process for consistency - Create feedback loop for continuous improvement ## Sample Interview Kit: Senior Software Engineer **Competency Framework**: - Technical Excellence: Deep technical skills and system design thinking - Mentoring & Impact: Growing others, influencing without authority - Bias for Action: Building real products, not just planning - Problem Solving: Breaking down complex problems, creative solutions - Collaboration: Working effectively cross-functionally - Learning Agility: Staying current, adapting to change **Interview Structure**: 1. Phone Screen (30 min): Background, role overview, initial technical assessment 2. Technical Interview (90 min): System design, code review, technical depth 3. Behavioral Interview (60 min): Mentoring, collaboration, impact 4. Culture & Leadership (45 min): Values, vision, growth mindset **Sample Questions**: - "Tell me about the most technically complex project you've led. Walk me through the architecture decisions." - "Describe a time you had to mentor someone with a different working style. How did you approach it?" - "When have you shipped something imperfect to meet a deadline? Why was that the right call?" - "Tell me about a time you disagreed with a product decision. How did you handle it?" ## Best Practices 1. **Structured Over Gut Feel**: Use scoring rubrics, not first impressions 2. **Diverse Interview Panels**: Include women, people of color, different perspectives 3. **Consistent Questions**: Ask all candidates the same core questions 4. **Blind Review**: Review resumes without names to reduce bias 5. **Feedback from Multiple Raters**: Don't over-weight one interviewer's opinion 6. **Reference Checks**: Verify key claims, look for patterns 7. **Debrief Carefully**: Discuss evidence, not gut feelings 8. **Continuous Improvement**: Track outcomes, refine process ## Common Mistakes to Avoid - Allowing interviewers to go off-script and ask different questions - Over-weighting resume vs. interview performance - Focusing on likability rather than competency - Asking illegal questions (family status, age, religion, etc.) - Making decisions without full interview panel input - Trusting first impressions over structured evaluation - Not documenting reasons for decisions - Interviewer bias unchecked (affinity bias, anchoring) ## Measuring Success - Time-to-hire (reduce without sacrificing quality) - Offer acceptance rate - New hire 90-day performance ratings - New hire 1-year retention rate - Diversity of hired candidates vs. applicant pool - Interview consistency scores - Manager satisfaction with hired candidates - Internal feedback on interview quality