This page shows how a recruiting team can shortlist candidates from large applicant volume using AI-powered candidate ranking in ATS Mako. You define what a strong candidate looks like. The AI parses every resume, scores each applicant against your criteria, and builds a ranked shortlist for the requisition. Your team starts the day with the strongest matches at the top instead of a wall of applications. The workflow below runs stage by stage and covers what to measure and where teams usually go wrong.
Why manual review breaks at volume
Manual resume review works when a role gets a handful of applicants. It stops working when a single posting fills up overnight. The problem is not effort. It is order. Recruiters read applications in the order they arrive, so a strong candidate who applied late sits at the bottom of the pile while the recruiter works through near misses at the top.
- Reading order is random. Arrival time decides who gets seen first, not fit.
- Standards drift. The fortieth resume of the day gets a different read than the fifth.
- Recruiters disagree. Two people screening the same role apply two different mental checklists.
- Good candidates move on. While the team is still reading, ready applicants accept other offers.
- Data entry eats the day. Copying skills and experience out of resumes is time not spent talking to people.
If your team already feels this, the guide on screening a high volume of applicants without burning out your team covers the people side. The rest of this page covers the system side.
Defining what a strong candidate looks like
AI ranking in ATS Mako is built on your criteria, not ours. That means the quality of the shortlist depends on how clearly you define the role before applications arrive. Spend time here. It is the single biggest lever you have.
Separate criteria into three groups: must-haves, strong signals and nice-to-haves. Must-haves should carry the most weight. Nice-to-haves should help break ties, not decide rankings on their own.
| Criteria group | What belongs here | How to weight it |
|---|---|---|
| Must-haves | Required skills, licenses or certifications, core experience | Highest weight. These separate real matches from near misses. |
| Strong signals | Relevant industry background, specific tools, depth of experience | Moderate weight. These order qualified candidates. |
| Nice-to-haves | Adjacent skills, bonus qualifications | Low weight. Use them to break ties. |
Role criteria worksheet
Role: [job title and location] Must-have keywords: [skill], [certification], [core experience] Strong-signal keywords: [tool], [industry], [specialty] Nice-to-have keywords: [adjacent skill], [bonus qualification] Experience weighting: [how much years of experience should matter for this role] What a near miss looks like: [the profile that looks close but is not a fit] Who signs off on these criteria: [hiring manager name]
Have the hiring manager approve this before the role goes live. It prevents rework when the shortlist does not match what they expected.
The signals the AI uses to rank applicants
Once criteria are set, the ranking engine combines four inputs. Knowing what each one does helps you read the shortlist with confidence.
Resume parsing and scanning
The AI extracts skills, experience and qualifications from each resume automatically. No retyping, no copy-paste, no manual data entry. Every applicant gets read the same way, whether they applied first or last.
Keyword scoring
Every candidate is scored against the keywords you defined for the role. This is what separates real matches from near misses quickly and consistently.
Custom weighting
You decide what carries weight, from must-have skills to years of experience. The AI ranks every applicant to that standard. Change the weighting and the rankings update to match.
Engagement scoring
Ranking is not only about the resume. The AI also factors in how candidates respond and engage, so applicants who are ready to move rise toward the top. In high-volume hiring, responsiveness often matters as much as the paper match.
The result is an intelligent shortlist built for each requisition. You can read more about how the engine works on the AI candidate ranking feature page.
The workflow, stage by stage
- 1 Set criteria before the role opens Use the worksheet above. Enter must-have, strong-signal and nice-to-have keywords, then set custom weighting. Get hiring manager sign-off.
- 2 Let applications flow in As resumes arrive, the AI parses and scans each one. Your team does not touch data entry. If you want a cleaner intake, look at how your apply pages capture applicants.
- 3 Open the ranked shortlist Instead of starting at the top of an inbox, open the requisition to a ranked shortlist. The strongest matches sit at the top, with engagement factored in.
- 4 Review the top of the list A recruiter reads the highest-ranked candidates and decides who moves forward. The AI sorted. The person decides.
- 5 Act on the top candidates Ranking and shortlists live in the same platform as communication, scheduling and pipeline tools. Move from shortlist to outreach without switching systems.
- 6 Check the next band down Before closing review, scan candidates just below the cut. This is where you catch strong people whose resumes undersell them.
- 7 Tune and repeat If the shortlist is off, adjust keywords or weighting. Rankings update to match. Use what you learn on the next requisition.
Acting on the top of the shortlist
A shortlist only helps if the team moves on it fast. Because ranking, shortlists and candidate communication sit in one platform, the gap between finding a strong applicant and contacting them shrinks. Many teams pair ranking with a screening step so the top of the list gets a first conversation quickly. The AI voice screening workflow for high volume roles shows one way to run that handoff.
Every candidate touchpoint runs inside your white-label platform: your logo, your colors, your domain. Candidates only see your brand, from first touch to offer letter. More on that in the overview of the white-label applicant tracking system.
Keeping human review in the loop
Nobody gets dropped by the ranking. Lower-ranked candidates stay in the pipeline and remain searchable, so you can revisit them as a role evolves or a new requisition opens. Teams that hire for similar roles across locations often find their next hire among people who ranked lower for a different opening. Global search and applicant management make that pool easy to work.
Consistency is the other reason human review gets easier. The same criteria and weighting apply across every requisition and every recruiter, so two people screening the same role start from the same list.
Tuning results over time
Treat your first set of criteria as a draft. After each role, compare who the AI ranked highly with who the hiring manager actually advanced. Where they disagree, find out why.
- Hired candidates ranked low? A keyword or skill the manager values is missing or underweighted.
- Top-ranked candidates rejected? A nice-to-have is carrying too much weight, or a must-have is too broad.
- Shortlist too thin? Your must-haves may be stricter than the role really needs.
- Shortlist too crowded? Add a strong-signal keyword that separates good from great.
Save the criteria that work as a starting point for the same role next time. Over a few cycles, your setup reflects what your hiring managers actually want.
Outcomes to measure
Results depend on your roles, your criteria and how fast your team acts. Track these to see whether ranking is helping, without assuming any particular number.
- Time from application to first recruiter review.
- Time from application to first contact for top-ranked candidates.
- Share of shortlisted candidates the hiring manager agrees to interview.
- How often hires come from the top of the ranked list versus further down.
- Recruiter hours spent on resume review per requisition.
- Candidates re-engaged from earlier pipelines for new openings.
Common pitfalls
- Skipping the criteria step. Vague keywords produce a vague shortlist.
- Weighting everything equally. If every criterion matters the same, none of them separate candidates.
- Treating the ranking as a decision. It is an order to review in, not a verdict.
- Never looking below the cut. Some strong candidates write weak resumes.
- Setting criteria once and forgetting them. Roles change, and your weighting should too.
- Shortlisting fast but reaching out slow. Engagement scoring surfaces ready candidates. Contact them while they are still ready.
For a broader take on ordering applicants when one role draws a crowd, see how to prioritize applicants at high volume.
See ranked shortlists on your own roles
Book a demo to walk through criteria setup, custom weighting and shortlists inside your branded platform, or review pricing first.