Passed the Audit, Still Screening People Out

by ai-intensify
0 comments
Abstract flat vector scene of one central sorting hub feeding many channels with some closed off, illustrating algorithmic hiring bias in screening tools

AI-generated article. This article was researched and drafted using AI tools and published automatically, and its featured image was generated by AI. Facts are drawn from the sources cited in the text.

Posting one job opening can produce three hundred applications. Nobody reads three hundred applications properly, so something has to filter them, and increasingly that something is software. The appeal is obvious and the time saving is real. The problem is that algorithmic hiring bias has turned out to be very good at surviving the exact checks designed to catch it.

A note first: what follows is a general summary of research and regulation, not legal advice. Anyone making hiring decisions at scale should get advice specific to their jurisdiction.

What four million applications showed

A 2026 Stanford study, one of the largest analyses of algorithmic hiring conducted so far, examined around four million job applications processed by a single screening vendor. Measured in aggregate, the tool looked acceptable. Measured role by role, it was systematically screening out candidates by race for particular positions.

Applying the Equal Employment Opportunity Commission’s four-fifths rule, the standard used in United States discrimination law to flag adverse impact, researchers found 26% of Black applicants and 15% of Asian applicants had applied to roles where the system disadvantaged their group. Had those candidates advanced at the same rate as the most favored group, roughly 40,000 additional applications would have moved forward. That is not a rounding error. Those are people who never heard back.

Why algorithmic hiring bias survives an audit

Bias audits are the main control regulators have reached for, and the Stanford finding exposes their weak point. A tool can clear an audit at the aggregate level while discriminating inside specific roles, because averaging across an entire company hides what happens in any one hiring pipeline. Coverage in Human Resources Director summarized the implication bluntly: passing the audit does not establish fairness.

The researchers also flagged something structural that individual employers cannot audit their way out of. Every application in that dataset went through one third-party vendor, a situation they call algorithmic monoculture. When thousands of employers license the same screening tool, one vendor’s blind spot stops being a company problem and becomes a labor market problem. A rejected candidate does not get a fresh assessment at the next employer. They get the same one.

The rules, and their gaps

New York City’s Local Law 144 requires employers using automated employment decision tools to commission an independent bias audit before deployment and annually after, and to publish the results. Penalties run from around $500 to $1,500 per violation. Enforcement has been the weak link: a Comptroller audit criticized the implementing agency over complaint intake and compliance review, though the agency has committed to acting on the findings.

In the European Union, AI used in employment is classified as high risk under the AI Act, which brings documentation, human oversight and data governance duties. The transparency layer applies now, alongside the disclosure obligations that became enforceable in August 2026, while the heavier high-risk requirements for hiring arrive later, in December 2027. Meanwhile the courts are moving independently. Mobley v. Workday, proceeding in San Francisco, is testing whether a software vendor itself can be liable for how its screening algorithms filter applicants, which would shift responsibility in a way no audit regime currently does.

What this means for a business hiring three people, not three thousand

Most small businesses are not licensing enterprise screening platforms. They are using the filtering built into a job board or an applicant tracking tool, often without registering that ranking is happening at all. That is the practical exposure. The tool was never chosen as an automated employment decision tool, so nobody asked what it does.

There is a fair counterweight here worth stating. Human screening is not a clean baseline. Decades of resume studies show people discriminate too, at scale, with less documentation and no audit trail whatsoever. The honest comparison is not software against fairness. It is software against a flawed human process, where at least the software can in principle be measured. That is the opportunity buried in this, and it is why the answer is not simply to switch the tools off. It is closely related to the way women get judged differently for the same work, and to who ends up in the highest paying AI roles.

One question worth asking this week

Find out whether anything in the current hiring stack ranks, scores or auto-rejects candidates. Not whether it uses AI, which vendors answer vaguely. Whether it orders or filters applicants before a person sees them. Support can usually answer this in one email.

If the answer is yes, the next question is what the ordering is based on, and whether rejected applications can still be viewed. Keeping the filtered pile visible costs nothing and is the difference between a tool that assists a decision and a tool that quietly makes it.

Related Articles