Hiring Managers: The science of first impressions is working against you. So are people on your candidate’s reference list. Here’s what to do about it.
Princeton psychologists discovered people judge a person’s trustworthiness and competence in one-tenth of a second, before a single word is even spoken.
The problem is what happens next. Once that impression forms, the brain spends the rest of the interaction looking for evidence to support it. Psychologists call this confirmation bias, and hiring managers often call it a strong interview.
The two are frequently indistinguishable, and that confusion can have costly consequences for organizations. The results are often seen in hiring outcomes. More than 40% of executive hires fail within the first 18 months, according to the executive search firm Heidrick & Struggles. The interview process finds and amplifies strengths. It all too often misses the risks.
Why Interviews Miss Leadership Risk
Behavioral psychologists identified a related phenomenon known as the halo effect: the tendency for one positive characteristic to influence broader judgments about a person.
In executive hiring, a commanding presence, a compelling career story or an impressive pedigree can shape perceptions of entirely unrelated capabilities. An articulate executive is perceived as having sound judgment. A charismatic executive is seen as a natural leader.
The snap judgment that was formed in the first moments of the meeting the candidate gets locked in by confirmation bias, and then the halo effect takes over until the candidate suddenly appears to be the answer to every problem at the company.
Organizational psychologist Tomas Chamorro-Premuzic notes that we should endeavor to counteract first impression bias: “One implication is to focus less on the impressions people make during job or media interviews, which are just an invitation to project our own biases and prejudices.”
Interviews provide a valuable but limited view of a candidate. They reveal how an executive performs in a structured environment designed to showcase strengths. They reveal far less about how that individual responds when expectations are missed, pressure rises or key stakeholders disagree.
Where The Risk Actually Lives
Consider what an interview process almost never reveals: What did this person do when the company missed its numbers two quarters running? How did they treat the direct reports who pushed back? What is their reputation not among the people they selected to speak for them, but among the people who were not personally asked by the candidate to provide a reference?
In one recent assessment, a CFO candidate arrived with five glowing references, every one of them positive in the specific, detailed way that signals preparation.
Conversations outside the candidate’s reference list told a different story. Two former direct reports described a pattern of accountability avoidance so consistent it had a name inside the team. When things went wrong, the attribution traveled downward. When things went right, it traveled up.
Nobody on the provided reference list mentioned this. They had no incentive to do so.
In another assessment, a CEO prospect praised as a strong strategist and problem-solver was described by an unprovided reference as defensive and inflexible, quick to dismiss others’ concerns and prone to understating risk.
Neither of these candidates appeared problematic at first glance. Their polished presentations created lasting positive impressions that were further bolstered by confirmation bias once the provided reference calls began.
These candidates understood the process well enough to perform exceptionally within it. And that’s precisely the problem. Their confidence was mistaken for competence.
Why Provided References Rarely Change the Decision
A handpicked reference is a controlled variable in an exercise designed to confirm what the interview already established. It is the halo effect with a crisp LinkedIn profile attached.
Provided references predict job performance just 13% of the time, researchers at the University of Iowa found. Reference checking ranks 13th out of 19 employee selection methods in predicting new hire success, according to hiring researchers Frank Schmidt and John Hunter.
And yet most executive hiring processes treat a warm provided reference call as full due diligence completed.
The most valuable perspectives are rarely on the provided reference list. They come from former direct reports who experienced the candidate’s leadership during a crisis, peers who saw concerning decisions firsthand, and former managers who observed behavioral patterns develop over time.
Finding those perspectives requires more than a routine reference check. It requires sourcing the right former colleagues, gaining the trust to have candid conversations, and asking strategic questions that focus on behavior and business outcomes over opinion. Not: “What do you think of this person?” Rather: “What did this person do when expectations were missed, pressure increased or stakeholders disagreed?”
The Pattern Is the Point
One conversation provides an observation. Three independent conversations describing the same behavior reveal a pattern. And patterns, not impressions, are what predict performance under pressure.
Leaders rarely change their fundamental operating tendencies. The executive who avoids accountability, sidesteps conflict or freezes when uncertainty rises is likely to do so again. Challenging circumstances actually reveal those behaviors.
Human Intelligence (HUMINT) is the disciplined practice of delicately unearthing those patterns before the offer is signed. HUMINT illuminates blind spots by conducting forensic references, which go beyond the standard candidate interviews and provided contacts.
Interviews show you how someone performs in a structured environment. Provided references show you who they carefully chose to speak on their behalf. Neither necessarily tells you how that person leads when tensions are high, performance falters or hard decisions have to be made.
What You Can Do to Find the Leadership Patterns Others Miss
Most hiring processes assess experience, credentials, and interview performance. Few are designed to illuminate how an executive leads when conditions become difficult. Well-intentioned hiring managers struggle to reduce the effect of confirmation bias when they speak to a candidate’s provided references. Having an objective third party who has never met the candidate conduct interviews with sources who are not provided by the candidate is a valuable tool to reduce the risks of snap judgments, confirmation bias, and the halo effect.
Our HUMINT services go further, and our conversations go deeper. Our goal is to piece together behavioral patterns that shape leadership effectiveness and the company’s bottom line. Through independent, unprovided source conversations, we uncover how leaders build trust, exercise accountability, navigate conflict, and perform under pressure. When the cost of a hiring mistake is significant, these insights provide a deeper understanding than resumes, interviews and curated references alone can provide.
