What to automate in hiring, and what to keep with your team.

Let AI write the interview guide for the role, the drafts, the reminders, and the summary at the end. Keep the conversations, the scores, and the choice. Here is a three-question test you can run on any hiring step, and one hire walked through eleven steps with each one marked.

The test: three questions for each step

Write your hiring process down as a list of steps, from deciding what the role needs to making the offer. Then ask three questions of each one.

  1. 1. Does it produce material, or a judgment about a person? A job post, a list of questions, a reminder, and a summary are material. Whether this candidate is strong, and whether to hire them, are judgments. Judgments stay with people. Many steps are both: reading applications is material work, choosing who to interview is a judgment. Split those in two.
  2. 2. Does the output reach a candidate? If it does, the agent prepares it and a person releases it. A rejection, an invitation, and an update are the first things a candidate sees of your company, and you want each one to have been read.
  3. 3. If it is wrong, how cheap is the fix? A weak interview question costs a minute of editing. A reminder sent a day early costs nothing. A wrong rejection costs you a good applicant. The cheaper the mistake, the more of the step you can hand over.

The answers sort every step into one of three:

Automate
The work runs start to finish without waiting on anyone, and a person reads the result when they use it. For material that stays inside your team, where a mistake is noticed and a fix is cheap.
Assist
The agent does the reading or the drafting, and a person makes the call on each item. For steps where a candidate is on the receiving end, or where the reading feeds a choice about a person.
Keep human
A person does the step. The agent can put material in front of them, and the step itself is theirs.

One hire, step by step

Dana runs a 25-person software company and is hiring her first customer success manager. She owns the hiring loop, her head of support is the second interviewer, and she uses Yardstick. The company and the people are invented; the steps are the point.

  1. 1. Decide what the role needs and design the interview

    Automate

    Dana describes the role in a few sentences: the product, the customers the hire will own, and what the first year has to produce. Yardstick drafts the outcomes for the role and designs the interview guide around them: the questions, the follow-ups, and a scorecard with a written anchor for every score. Dana reads it, changes two outcomes that were aimed at a bigger company, and cuts one question.

    Why: This is the step that matters most, because the job description, the application scores and the interview all come from it. AI drafts it so it gets done well and fast, and you read and edit it until it describes the job you actually need filled.

  2. 2. Write the job description

    Automate

    Dana’s own agent drafts the job description from the same outcomes, so the post and the interview ask for the same things. Dana edits the tone and publishes it to the careers page.

    Why: It is a draft, and nobody outside the company sees it until Dana publishes it. Read it closely anyway, because it is the first thing a candidate sees and it should ask for the same outcomes the interview checks.

  3. 3. Read the applications

    Assist

    Application review scores every application against the criteria Dana set for the role. Dana works down the queue with the scores beside each name and picks the eight people she wants to talk to.

    Why: The reading is volume work and suits AI. Choosing who gets an interview hour is a choice about a person, so it splits: the scores read, Dana chooses.

  4. 4. Tell the people who are not a fit

    Assist

    The built-in agent screen new applicants nightly reads each day’s applications against the role and prepares a rejection draft for the ones that do not match, held for review. Dana confirms the ones she agrees with, and those drafts move into her normal review before they go out.

    Why: The email reaches a candidate, and a wrong one costs a good applicant. The agent writes it; a person releases it.

  5. 5. Schedule the interviews

    Assist

    Interview times come from the Cal.com or Calendly account Dana already uses, and her own agent drafts the invitation for her to send.

    Why: The invitation goes to a candidate, so a person sends it. The back and forth over times is what the calendar tool is for.

  6. 6. Prepare the interviewers

    Automate

    The built-in agent prep interview kits for next week’s sessions emails each assigned interviewer their kit: the candidate and role context, the questions, the scorecard anchors, and the logistics.

    Why: It goes to Dana's own team, it only reads the schedule and candidate records, and a kit with a gap in it gets noticed by the interviewer who opens it.

  7. 7. Run the interview

    Keep human

    Dana and her head of support interview from the guide. The follow-ups are written into the guide, and which one to ask depends on what the candidate just said. That is also what interviewing when candidates are using AI comes down to.

    Why: The interview is a judgment about a person, made in real time, and it is where the evidence comes from.

  8. 8. Score the candidate

    Keep human

    Each interviewer scores the candidate against the written anchors before seeing anyone else’s score, so two people who heard the same answer can land on the same number. Why interviewers disagree covers what happens when they do not.

    Why: The score is the interviewer's record of what they heard. It is only evidence if the person who heard it wrote it.

  9. 9. Collect the missing scorecards

    Automate

    The built-in agent chase missing scorecards sends reminders to the interviewers who have not filed feedback, and the last reminder escalates to Dana as the hiring manager.

    Why: It is the most repetitive job in hiring, it goes to the team, and a reminder sent one day early costs nothing.

  10. 10. Pull the evidence together

    Automate

    Once the assigned scorecards for a candidate are in, the built-in agent prepare a panel decision brief writes one brief from the completed scorecards for the panel to review.

    Why: It is a summary of evidence people already wrote, read by the same people. The debrief starts from the scorecards instead of from memory.

  11. 11. Decide, and make the offer

    Keep human

    Dana and her head of support read the brief, talk through the one criterion where they scored differently, and choose. Dana calls the candidate with the offer herself; the job offer guide covers that call.

    Why: This is the step every other step exists to inform.

Where the agents in that example come from

Two kinds of agent did the work in Dana’s hire. The built-in agents are hosted in Yardstick, and each one watches for one moment in your hiring and does one job when it arrives: an interview coming up next week, a scorecard still outstanding, the day’s new applications, a candidate whose scorecards are all in. You pick one from the catalog, preview what it will do, and confirm it.

The other kind is your own agent. If you already work in Claude Code or Codex, it runs the yardstick CLI; if you work in ChatGPT or Claude, it connects over the MCP server. Either way it can draft the job description, the interview guide, and the invitation from your notes while you work, and publishing a job, advancing or rejecting a candidate, or sending a one-off candidate email waits for your approval.

Application review is on for every account, so the scores in step three are available from the first role you open.

How to read an AI hiring tool’s claims

The same test works on a vendor’s feature list, including ours. For each step a tool says it handles, ask three things.

  1. What exactly does it produce? A score, a draft email, a list of questions, a summary. If the answer is a result (“better hires”, “less bias”) rather than a thing you can open and read, there is nothing to check.
  2. Where does it go? To you, to an interviewer, or to a candidate. Each built-in agent in the example has one destination, and you can say what it is. Ask for the same of every automation in a trial.
  3. What can you see before it counts? The criteria behind a score, the draft before it sends, the brief beside the scorecards it came from. Run one real role through the trial and open each of those before you decide which steps to hand over.

Frequently asked questions

What parts of hiring can be automated?

The parts that produce material for your own team: the interview guide and scorecard for the role, the job description draft, the interviewer prep kits, the reminders to interviewers who owe feedback, and the summary of completed scorecards before the debrief. The reading of applications can be automated too, as scores against the criteria you set, with a person choosing who to interview from them. Anything that reaches a candidate, such as a rejection or an invitation, works best drafted by the agent and sent by a person.

What should stay human in hiring?

The interview, the scoring, and the decision. The interview depends on following what the candidate just said. The score is only evidence if the person who heard the answer wrote it. And the decision is what the rest of the process exists to inform. Everything around those three steps is good work for an agent.

Should I let AI reject applicants?

Let it draft the rejection, and have a person send it. A rejection is a judgment about a person, and a wrong one costs you a good applicant. In Yardstick, application review scores applications against your criteria to help you decide who to talk to first. Separately, the screen new applicants nightly agent prepares rejection drafts held for review, and your reviewer confirms each one before it goes out.

Are AI hiring tools overpromising?

Some claims are easier to check than others. Ask any tool three things about each step it says it handles: what exactly it produces, where that output goes (to you, to an interviewer, or to a candidate), and what you can see before it counts. A claim that names an output and a destination can be checked in a trial. A claim that names only a result cannot.

Will AI-written interview questions be any good?

Treat them as a first draft that is easy to fix. A draft written for the specific role, with follow-ups and a written anchor for every score, is a better starting point than a blank page or a generic question bank, and you read it before the first interview. Correcting an outcome or cutting a question takes a minute; writing a guide from nothing is a step small teams often skip.

Do I need a coding agent to use Yardstick's agents?

No. The built-in agents run inside Yardstick: you pick one from the catalog, preview what it will do, and confirm it. If you already work in Claude Code, Codex, ChatGPT, or Claude, your own agent can also operate Yardstick through the CLI or the MCP server and draft the interview guide from your notes.

Start with the interview guide.

Describe the role, get the interview guide and anchored scorecard designed for it, and turn on the agents for the prep and the reminders. Your first three Jobs are free.