How an LL144 Bias Audit Actually Works
NYC Local Law 144 requires an independent bias audit of automated employment decision tools (AEDTs). Here is exactly what the audit computes, per the DCWP Final Rules (6 RCNY Subchapter T).
The statistical core
- Selection rate: for each protected category (sex, ethnicity, and their intersections), the share of candidates selected by the tool.
- Impact ratio: each category's selection rate divided by the highest selection rate among categories. A ratio below 0.80 (the "four-fifths rule") signals possible adverse impact.
- Score-based metrics: for tools that score candidates on a continuous scale, the audit computes scoring rates above the median score and a score-based impact ratio.
What the audit does NOT do
The audit does not judge whether the tool is "good" or "fair" in an abstract sense — it measures statistical parity against the EEOC's four-fifths framework, which has been the standard for adverse impact analysis since 1978. It also does not require the vendor's source code; it works from the tool's outputs on real candidate data.
What you get
- A detailed report with per-category selection rates and impact ratios.
- A public summary suitable for posting on your careers site (required by the law).
- A candidate notice template (10 business days' notice requirement).
ComplyLens computes all of these statistics deterministically from your ATS export — no black box, no LLM-generated numbers — and delivers the report in 72 hours.