How do I interview when candidates are using AI?
A hiring manager on Hacker News put it this way: “qualified candidates are showing up obviously reading from prompts.” The application was polished, the take-home came back finished, and on the live call there is a pause before every answer and then a paragraph. What you want is an interview that still tells you who can do the job, without turning it into a trap. That is a question design problem, and this page hands you the questions.
“Have you had someone pass an interview and then later they can barely perform?”
That is another hiring manager, and the thread’s answer was yes. It helps to be precise about where AI shows up, because the fix is different at each point.
The application. A model writes a tailored cover letter and a resume that mirrors your job description, and sends it to two hundred jobs in an afternoon. The result is a queue of applications that all read well, which tells you almost nothing about who is in it.
The take-home. A coding exercise, a writing sample, a mock sales email, a sample spreadsheet. If it can be described in a prompt, a model can produce a competent version of it, and the candidate may or may not understand what they sent you.
The live call. An overlay listens to the conversation, transcribes your question, and puts an answer on the candidate’s screen while you wait. Greenhouse reported in January 2026 that 35% of recruiters had seen candidates using AI during a live interview, and Lever cited the 2026 Job Seeker Nation report in August with 37% of candidates saying they use AI for real-time responses in interviews. Whatever the exact figure in your pipeline, it is not zero, and it is not going to fall.
“I’m rejecting all of those candidates the instant I notice”
That was the first policy of the manager quoted at the top, and it is the wrong fix for three reasons. You lose the good candidates who used AI to prepare and are now nervous and reading their own notes, because from your side of the camera that looks the same. You keep the candidates who are better at hiding it, which is the opposite of the skill you are hiring for. And, as the thread worked out, you do not actually object to the tools: the same manager clarified that it was never about whether someone uses Cursor or Claude at work, and everyone will. The objection is to answers that are not theirs.
So the goal is narrower than “catch AI use.” It is to run an interview where the answers you score could only have come from the person in front of you. That is a change to the questions, not a change to your monitoring.
“If ChatGPT can solve your questions, what does that say about your questions?”
That is a reply in a 2022 thread titled “ChatGPT can solve my interview questions, now what?”, and it is still the right place to start. Any question whose answer exists in general is a search query now: explain the difference between X and Y, how would you approach Z, what makes a good onboarding process. The candidate does not need to have done anything to answer it, so it never told you much, and now it tells you nothing.
The replacement is a question that only someone who did the work can answer: a specific past event, in their own history, that you are going to follow into the detail. Two pairs, one technical and one not.
Backend engineer
Before: “Explain the difference between optimistic and pessimistic locking, and when you would use each.”
After: “Tell me about the last time a concurrency bug reached production on something you owned. How did you find it, what did you change, and what did it cost while it was live?”
The first is a textbook entry. The second has an answer only in the head of the person who lived it, and every follow-up (which service, who noticed, why that fix) makes it harder for a model to keep up.
Account executive
Before: “How do you handle objections about price?”
After: “Walk me through the last deal where the buyer said the price was too high. What exactly did they say, what did you say next, and how did the deal end?”
Every sales blog has an answer to the first one. The second needs a company, a buyer, a number, and a sequence of events, and you are going to ask about each of them. It does not require a win: a rep who handled the objection well and still lost, or handled it badly and closed anyway, has just as much to tell you.
Write the “after” version for every competency on your scorecard before the first interview, and ask the same one of every candidate. The candidate who prepared with AI and the one who did not are then scored on the same thing: what they actually did.
“Tell me about the project you’re most proud of”, then dig in
The follow-up is the test. An overlay can produce a fluent first answer to almost anything. What it cannot produce, live, is the specific sequence of what one person did on one Tuesday, why they chose it over the alternative, who they called for help, what the number was afterwards, and what they got wrong. Those live in the candidate’s memory or nowhere, and a candidate who is reading answers from a screen has to wait for each one, then gets a plausible generality instead of a fact. By the fourth follow-up the difference is obvious to anyone.
There are seven directions a follow-up can go. Here is the question for each, in words you can use as they are.
Situation
“What was the state of things when you picked this up? What was broken, and who cared?”
Actions taken
“What did you do first? Then what? Then what?”
Reasons for the actions
“Why that, and not the obvious alternative? What did you rule out?”
Help used
“Who did you pull in, and what did they do that you could not do yourself?”
Results
“What changed? What was the number before and after, and how did you know?”
Lessons learned
“What would you not do again?”
Lessons applied
“Where have you used that since?”
You will not use all seven on every answer, and you should not force it. The point is that when the first answer sounds too clean, you know exactly where to go next instead of nodding and moving on. How to ask follow-up questions covers the framework in depth and what each dimension tells you about a competency.
A worked sequence: account executive
The candidate and the deal are invented; the shape of the sequence is the point. Each step gives the question and what to listen for.
1. “Tell me about the deal you are most proud of.”
The first answer is the one a model can write: a complex enterprise deal, multiple stakeholders, consultative approach, closed above target. Do not score it yet. It is the opening, not the evidence.
2. “Which company was it, what do they sell, and who was your first contact there?”
A real answer names a company, an industry, and a job title, and does it quickly. An answer that stays at "a mid-sized logistics firm" and "a senior stakeholder" is a flag, not a verdict. Keep going.
3. “What did you do in the week after that first call?”
You are asking for actions in order. The candidate who did the work says something like: sent a recap, asked for an intro to the operations lead, built a one-page cost estimate. The candidate reading an answer gets a summary of a sales methodology.
4. “Why go to the operations lead instead of staying with your champion?”
This is the judgment question. A real reason is specific to that deal: the champion could not sign, the budget sat in operations, the champion asked for it. There is no general answer, which is why this one is hard to fake live.
5. “Who else worked on it, and what did they do that you could not?”
Listen for named help: a solutions engineer who ran the technical review, a manager who approved a discount. A candidate who did everything alone on a complex deal either is exceptional or was not on the deal.
6. “What was the contract worth, and how long did it take from first call to signature?”
A number and a duration, said without hesitation. If the number moves during the conversation, ask about the move.
7. “What would you do differently, and where have you done it since?”
The last two dimensions together. A real deal leaves a regret (brought in the operations lead a month too late) and a habit (now asks about budget ownership on the first call). Ask for the next deal where the habit showed up.
Seven questions, maybe twelve minutes. Nowhere in that sequence did you accuse anyone of anything, and nowhere did an overlay have anything useful to offer. A candidate who lived the deal finds the questions easy and rather enjoys them. That is the tell you want: the interview gets easier for the real candidate and harder for the one reading.
The same sequence for an engineer
1. “Tell me about the project you are most proud of.”
Again, the first answer proves nothing either way. A migration, a rewrite, a system that handled more load. Note it and go in.
2. “What was breaking before you started, and who was feeling it?”
Situation. A real answer has a symptom (timeouts on the checkout page every Monday morning) and a person who complained about it.
3. “What was the first change you shipped, and why that one first?”
Actions and reasons together. Ordering is where reading from a prompt falls apart: a model can describe a good architecture, but it cannot tell you why this team did step three before step two.
4. “What did you get wrong along the way, and how did you find out?”
Every real project has one. Listen for how they found out (an alert, a customer, a colleague in review) and what they did in the hour after.
5. “Who reviewed it, and what did they push back on?”
Help used. Named reviewers and a specific objection. A project with no pushback is usually a project the candidate watched rather than led.
6. “What were the numbers before and after, and what would you change if you did it again?”
Results and lessons. Latency, error rate, cost, deploy frequency, whichever one the project was for. Then the regret, and where they have applied it since.
For a customer support lead, an operations manager or a marketer, swap the nouns and keep the order: the state of the queue when they arrived, the first change, why that one, who helped, the number afterwards, the regret, the habit. The framework does not care what the work was, only that the candidate did it.
“Give them a real problem”
Take-homes and work samples still work, on three conditions.
- 1. Short. Two or three hours, not a weekend. Long take-homes select for candidates with free time and hand a model the biggest possible advantage. A small task on something close to your real work tells you more.
- 2. The same for every candidate. One exercise per role, judged against the same anchors, so the comparison is between candidates and not between exercises.
- 3. Discussed live. The artifact is the opening, not the evidence. In the conversation, ask them to change one requirement and say what breaks. Ask which part they would be least happy defending. Pick one choice they made and ask why that and not the alternative. A candidate who did the work answers all three without effort; a candidate who pasted a prompt cannot answer the first one.
For an engineer, the sample is a review of a small piece of your actual code, or a two-hour task in your stack with whatever tools they would use on the job. For a salesperson, it is a discovery call on your product with you playing the buyer, and halfway through you change the objection. For an operations hire, it is a real backlog or a messy spreadsheet from last quarter and the question “what would you do on Monday?” None of these has a screen to watch, and none of them needs one. Work sample exercises has examples by role.
“How do I stop AI-written applications getting through?”
You mostly do not, and you do not need to. Detecting AI-written text is unreliable in both directions, and a well-written application has never been evidence that someone can do the job. What you change is how much weight the application carries.
Add two or three screening questions to the application form with a fixed answer: a yes/no on a certification the role requires, a multiple-choice on the shift pattern, a number for years in the specific role. A candidate answers them when they apply, and an application that misses the answer you set is marked in your queue so your team sees it at a glance and decides what happens next. That is a plain rule, and it catches the mass-sent application that never read the posting.
Then review the queue against the criteria you wrote for the role, rather than against how well the letter reads. In Yardstick, application review scores each incoming application against the job-related criteria you defined, so you read the likely fits first and spend the interview hours on them. The interview, with the follow-ups above, then does the work the application cannot.
“Should I tell candidates what’s allowed?”
Yes, in the invitation. Greenhouse surveyed 2,950 job seekers in April 2026 and 80% said employer AI policies were vague or absent. A candidate who does not know where the line is will guess, and the honest ones guess conservatively and under-prepare. Say what they may use to prepare, what they may not use live, and what you use on your side. Three lines is enough. These can be pasted as they are:
You are welcome to use AI tools to prepare: to research us, practice, and organize your examples.
During the live interview, please answer in your own words without AI assistance. We will ask about your own work in detail, and that is the part we are interested in.
On our side, we use AI to help write the interview questions and to help review applications. A person on our team makes every hiring decision.
If you send a take-home, add a fourth line saying which tools are allowed on it (usually: the ones they would use on the job) and that you will discuss it with them live.
“Do I need proctoring software?”
For a small team, no. Proctoring tools watch a screen for a second window and a face for a wandering gaze, and they produce a probability that you then have to act on. A live conversation about the candidate’s own work, followed along the seven dimensions, with the same questions for every candidate, does what the detector claims to do and produces evidence you can compare instead of a suspicion you cannot. It also works for the roles where there is no screen to watch, which for most companies is most of the roles.
What this looks like in Yardstick
The hard part of everything above is doing it before the first interview: the “after” version of every question, the follow-ups under each one, and an anchor for each score, for this role. Written on the day, it does not happen, and the interviewer improvises the moment a first answer sounds too clean.
In Yardstick you describe the role and AI designs the interview guide for it: questions about specific past work, the follow-up questions under each one, and a scorecard with a sentence for every score describing what that level of evidence sounds like. You edit the draft, which is easier than writing it, and it is ready before anyone is scheduled. Example interview guides show what one looks like for a role like yours, and how to build an interview scorecard covers writing the anchors yourself.
Every candidate then has the same important conversation, and every interviewer scores what they heard against the anchors rather than against an impression of how fluent the candidate was. The candidate who read a first answer from a screen and the one who did not end up side by side on one scorecard, scored on the follow-ups, which is where the difference was. Your first three Jobs are free, and after that you pay per open role, not per seat.
Frequently asked questions
Is it cheating for a candidate to use AI to prepare for an interview?
No. Researching the company, practicing answers, and organizing examples with an AI tool is the same preparation people have always done with a friend or a book, and you should say so in the invitation. The line most teams draw is live use: an AI tool reading the conversation and feeding answers during the interview, or completing a take-home the candidate then cannot discuss. Draw the line explicitly, tell candidates where it is, and design the interview so that the answers you score are ones only the candidate could give.
Should I let candidates use Claude or Cursor in a coding interview?
If they will use those tools on the job, yes, and watch how they use them. Give a short task on something close to your real code, let them work with the tools they would normally use, then talk through it: ask them to change one requirement, find the weakest part, and explain a choice the tool made for them. The candidate who understands the work can do all three. The candidate who pasted a prompt and accepted the result cannot. What you are assessing is the judgment on top of the tool, which is the job.
Can I tell a candidate is using AI from their eye movement or pauses?
Sometimes, and it is a poor basis for a decision. Candidates look away when they think, pause when they are nervous, and read from notes they wrote themselves. Treat a pattern of polished first answers followed by thin follow-ups as a reason to go deeper, not as a finding. If the detail holds up through seven follow-ups, the candidate did the work, whatever their eyes were doing. If it does not, you have your answer without having to accuse anyone of anything.
What about candidates who have someone else take the interview for them?
It happens, mostly in remote technical hiring. The same design protects you: a live conversation about the candidate's own specific past work, camera on, followed by a work sample discussed live in a later round with the same interviewer. Someone standing in for the candidate has to be consistent across rounds and across the detail of a real history, which is far harder than passing a single screen. If you suspect a substitution, a short in-person or video session with an identity check before the offer is reasonable and worth saying up front in your process.
Does a take-home assignment still make sense?
Yes, with two changes. Keep it short (two or three hours, not a weekend), so you are not asking for free work and so a candidate with a job can do it. And never score the artifact on its own. Score the live discussion of it: what they would change, what they would cut under a new constraint, why they made one particular choice. A model can produce the take-home. It cannot sit in the follow-up conversation and defend it.
Get the follow-up questions written before the first call.
Describe the role, get the interview guide with the follow-ups and the anchored scorecard for it, and ask every candidate the questions a model cannot answer for them. Your first three Jobs are free.
.webp?dpl=dpl_5uDjtcSukDkMdrviVp8VPHXTnhQq)