Skip to content
Interface language: English
Imperium / Signal

Two great interviews, nothing to compare: how to gather evidence in hiring

Connect interview questions to the work of the role. Compare actions described by candidates, define rating meanings and preserve the basis of the decision after interviews.

Article language: English

Concept illustration: a woman rests her hands on the outer two of three round discs mounted on an axis in a navy and red interior.
In this article

After the first interview the team writes, “We got on brilliantly.” After the second: “A very practical person.” When it is time to compare candidates, one conversation turns out to have covered working with a client and the other dealing with a delay. The impressions are vivid, but the material for the decision does not match.

Consider a hypothetical small workshop sewing covers that is looking for an order coordinator. The role requires recognising a change requested by a client, checking its effect with production and returning with a confirmed answer. Two people describe how they rescued a difficult order. The employer wants to establish what each person did and what their decision was based on. Fluency in telling the story is a different piece of information.

Here, a structured interview means preparing common questions and rules for interpreting answers. After the meetings, the company should be able to identify a basis for comparison rather than choosing the most persuasive description of a general impression.

Start with the work someone will take over

A job title often covers several different expectations. A “coordinator” may draft an answer, independently confirm a standard deadline or arrange for someone else to decide. The team should establish the scope before the interview. Otherwise one assessor may seek an independent negotiator and another someone who manages information flow, even though both mark the same competency name.

At the workshop, choose a specific situation from the task: a client changes a cover's dimensions after the scope was agreed. The coordinator must recognise the change, pass it on for assessment and return with agreed information. They do not have to assess the entire sewing technology themselves. State this boundary from the outset so the company does not mistake consulting a specialist for a lack of independence.

The task described this way can later help onboard an employee into the company's knowledge (in Polish), but a hiring interview has a different purpose. Before hiring, the company gathers material about a person's past or proposed actions. After hiring, it provides its own sources and checks work in its own environment. It cannot expect knowledge of undisclosed internal rules at the first meeting.

Ask the team what would be useful evidence for this role. It might be distinguishing a client's request from an accepted commitment, identifying the right person to consult or checking whether an answer reached production. Do not choose a task merely because it sounds impressive. A story of a major crisis can reveal less about daily work than a well-described ordinary order.

Also examine the capability needed across the team (in Polish). If other employees can prepare a technical answer but nobody connects it with the order, that connection may be the need. Do not add replacing every existing specialist to the candidate's task under one broad heading such as “getting things sorted”.

A common question must lead to comparable information

OPM, the US federal personnel agency, in its definition of a structured interview describes questions about past behaviour or proposed action in a hypothetical situation. It describes the same predetermined questions, their order, and common rating scales and standards. This is material from a US institution used here for its method; it does not describe a Polish employer's obligations.

For our workshop, a question could concern a past order change: what changed, what the person was responsible for and how they established the next step. Do not immediately ask for proof of heroism. It is also useful to learn what a candidate could not decide alone and how they directed the matter to the right person. That is part of the task the company wants to assign.

The first person describes how the team quickly agreed a new deadline. Follow-up reveals that they received the client's message and passed it to the manager but did not take part in the later assessment. The second tells the story less fluently but explains what information they gathered, with whom they confirmed the change was possible and how they returned to the client. Those are different scopes of action. There is no need to invent personality traits to preserve the difference.

This does not prove that the first person worked improperly. In their previous organisation the role may have ended with receiving the request and passing it to the manager. Their description would then match their actual task. For our workshop, however, the question of work connecting information from several places remains open. The reason for a choice should distinguish the absence of an example from proof that someone failed to perform their own duty.

The second person may describe a fuller role without achieving the deadline the client wanted. Find out what they could establish and how they explained the constraint. If the client changed the order and production confirmed a different possible deadline, saying no may have been part of proper service. Conversely, a story of meeting the date does not yet prove that the scope was agreed with the people doing the work. Read the outcome together with the actions and conditions rather than rewarding a happy ending alone.

Record a specific action and where it occurred in the story. “Good communication” is an assessment. “She confirmed that the message concerned the second order before passing the change on” describes a reported action. It can later be related to a criterion. If a note contains only the assessment, another interviewer cannot reconstruct its basis.

Agree how to ask follow-up questions too. If one person hears a prompt about their own contribution, the other should have a comparable opportunity to clarify an answer within the same scope. Do not guide one selected person step by step to an expected sentence and judge another only on the first attempt. A follow-up should clarify information, not create it for the speaker.

Aeneia conceptual photography

In a review by Levashina and co-authors in the 2014 volume of Personnel Psychology, the authors examine topics in research on structured interviews, including rating scales, questions about past and hypothetical situations, follow-up questions and impression management, meaning how an interviewee presents themselves. The authors also identify open research questions. They do not reduce the issue to reading an identical list.

For the workshop this is a reason to prepare the interviewers too. One might ask about the result, another about the data and another about the difficulty of the situation. They need to know what each kind of information contributes to assessing the task. Not every interesting digression deserves its own points simply because the candidate tells it well.

A rating scale needs meaning before the meeting

A number from one to five does not itself explain the difference between answers. To one person a four might mean complete performance of a task; to another, an exceptionally persuasive presentation. Before using a scale, describe which actions correspond to its levels. People who know the actual work should prepare the material.

OPM's practical guide of September 2008, in its section on scales, connects levels with behavioural examples and participation by experts in the work. It notes that examples are guidance, not an absolute template for every answer. A candidate's story can unfold differently and still provide information about the task being assessed.

A common scale at the workshop might distinguish no identifiable personal action, a partial account of the change process, and an account including checking and confirming the subsequent response. This is a working proposal for the illustrated task, not a ready-made psychometric test. Before using it, check whether assessors understand the levels similarly and whether the description fits the role.

Do not automatically give the lowest rating for every gap. Missing information in an answer and a description of improper action are different observations. Perhaps a candidate did not give an outcome because the question did not lead them to it. Perhaps even after agreed follow-up their contribution remains unclear. Preserve that state in the note instead of pretending the interview supplied certainty it did not.

Before further interviews, two people can independently read the same prepared example and justify their ratings. If one sees independent recognition of the change and the other only the passing on of a message, return to the specific passage. The criterion may need improvement, another question or an interpretation may need correction. Averaging two numbers will not explain the disagreement.

A similar question about the order of information arises when assessing a concept without its author's name (in Polish). There the subject is an idea; here it is an answer about work. In both cases it helps to identify what the material actually supports. We are not, however, transferring anonymous concept assessment to the entire hiring process.

Compare answers with the task, then record the decision

After an interview, start with a note on the action in each agreed area. Comparing candidates should not require inventing criteria after the people are already known. If a new role need emerges, name the change and decide how to complete the material. Do not assess earlier interviews against a question that was never asked in them.

Discuss differences as you would feedback on an expert's work (in Polish): identify the passage, its connection with the task and the missing information. In hiring you are not editing the candidate into a target version. You can nevertheless use the same discipline of description so a general “I am not convinced” does not end the discussion without a reason.

Also retain strengths that do not settle a particular criterion. Someone may tell a story very clearly while still not explaining their role in the decision. If clear communication is part of the role, define an appropriate way to assess it. It should not accidentally raise every other rating simply because the answers were pleasant to listen to.

When choosing, indicate which information the company found sufficient and what remains to be checked in a later stage. An interview does not show all of a person's future work. You do not have to promise complete impartiality to improve the quality of the reasoning. Formal hiring conditions and data processing require their own appropriate review; a foreign methodological guide does not replace it.

A candidate should know in advance what work they are coming to do

If an advertisement promises “growth in a creative team” while the interview concerns independently organising order changes, examine the discrepancy. Someone preparing for the meeting should know the basic tasks and how contact will proceed. These can be explained without publishing ready-made answers to every question.

A team page (in Polish) can show roles through the work people do. A careers section can similarly describe collaboration and the boundaries of the new role's responsibility. Such material helps people understand the job offer. It does not itself conduct recruitment or decide whom to choose.

At Aeneia Design, the discussion can concern the content and layout of a careers page: how to present tasks, the team and the next contact stages. The company brings its own decisions about the role. Design translates them into an understandable path from the job description to an application.

Before the next two interviews, the workshop should be able to name one task being assessed, ask a comparable question and explain the difference between the answers received. If the notes still say only that both people were great, return to the material needed for the decision. A good meeting can remain a good meeting. Choosing an employee also needs a basis connected to the work.

Aeneia / Aeneia editorial

Editorial article. Source links are included in the text.

About Aeneia

Brands we have worked with

  • L’Oréal
  • Garnier
  • Netflix
  • Carrefour
  • Warner Bros. Discovery
  • Biedronka
  • HBO Max
  • Wolt
  • Żabka
  • COSRX
  • Embassy of China in Poland
  • Mixa
Aeneia / Initium

From knowledge to a decision

Tell us what you want to put in order. We will agree on where to start.

Contact Aeneia

We partner with and use solutions from:

  • Google
  • OpenAI
  • Microsoft
  • Stripe
  • Anthropic
  • Linear