unstructured chats measure comfort and similarity; structured questions with a scoring key predict performance
Unstructured interviews mostly measure rapport between two people in a room, not the candidate's ability to do the job. Structured interviews replace conversation with a pre-written scoring rubric, so the decision rests on comparable evidence rather than mood.
When no rubric exists, the interviewer fills the silence with whatever signals feel reassuring in the moment. A candidate who mirrors the interviewer's humor, shares an alma mater, or simply seems relaxed scores well for reasons that have nothing to do with the role. Comfort and competence overlap, but only partly, and the gap is where bad hires come from. Once a decision feels right in the body, the brain tends to retrofit reasons for it, which is why gut hires are remembered as wins even when the track record is mixed.
The format is mechanical on purpose. Before any candidate arrives, the hiring team writes a list of the job's core skills, then writes one question per skill. Each question comes with a scoring scale, often 1 to 5, anchored by short descriptions of what a 1, 3, and 5 answer looks like. Every candidate gets the same questions in the same order, scored against the same anchors. Two interviewers scoring the same transcript independently usually agree closely, which is the property unstructured chats lack.
A worked example for a junior analyst role:
Friendliness adds no points. A charming candidate who spots the wrong row scores a 1.
Many people hear "structured" and picture a script read aloud like a robot, then assume the format kills the signal a thoughtful interviewer would otherwise catch. The opposite is usually true. The rubric forces the interviewer to write down, before meeting anyone, what a good answer actually looks like. That work, done once, replaces dozens of vague impressions collected over months.
Structured interviews are well suited to roles where the work can be sampled in a short exchange, such as customer support, junior analysis, or technical writing. They are weaker for senior roles where the sample question cannot approximate the actual decisions the hire will make, and for creative or relational work where the artifact is the person rather than a deliverable. In those cases, work samples, trial projects, or panel reviews across multiple candidates tend to carry more signal than any interview format.
Write the scorecard before posting the role. List three to five skills the job genuinely requires, attach one question and one rubric to each, and require every interviewer to score independently before discussing the candidate. Comparing numbers is faster and fairer than comparing memories.
Cram I have hired three great people based on gut feeling in conversation. What is wrong with that?
Rep Plenty. Unstructured chats are mostly measuring how comfortable the two of you feel, and comfort at work is not the job.
Cram Comfort? I thought a good interview told you whether someone could do the work.
Rep It tells you whether you would enjoy a coffee with them. Studies keep finding unstructured interviews barely predict performance.
Cram So what is the better kind?
Rep Structured. The same questions, asked the same way, with a scoring rubric written down before the person walks in.
Cram That sounds robotic. How does that find talent?
Rep It forces the interviewer to compare answers, not vibes. Two interviewers scoring the same answers usually land close together.
Cram And what does the rubric actually measure?
Rep The skills named on the scorecard, one per question. Friendly tone does not score a point, evidence does.
Cram What about gut feelings about whether someone is a culture fit?
Rep That is the most biased part of the interview. Gut feelings drift toward people who remind you of yourself.
Cram But surely years of experience teach you to read people.
Rep Years teach you patterns. The pattern a tired hiring manager keeps matching is their younger self, which narrows the pool without anyone noticing.
Cram So what should I actually do on Monday morning?
Rep Write the scorecard first. Pick the questions that test the real work. Score every answer on the same scale. Compare numbers, not memories.