Disparate Impact
Definition
A legal and statistical concept describing a policy or practice that has a disproportionate adverse effect on a protected group, regardless of intent. Applied to biometric systems: a system with higher error rates for a particular racial group creates disparate impact on that group's members even if the system was not designed with discriminatory intent.
- Concept type
- Legal and statistical
- Intent required
- No, effect-based regardless of intent
- Forensic application
- Unequal error rates in biometric matching
- Field
- Bias in face and fingerprint matching
Common questions
How is disparate impact measured in a biometric system?+
By comparing false-match and false-non-match rates across demographic groups, typically stratified by factors such as skin tone, sex, or age, and testing whether any group experiences a statistically higher error rate than others.
Why does disparate impact matter even without discriminatory intent?+
A system deployed neutrally can still produce systematically worse outcomes for a protected group because of how it was trained or calibrated, and courts and oversight bodies in several jurisdictions treat that unequal effect as a legally relevant harm on its own.
Related terms
- AFIS (Automated Fingerprint Identification System)
- An automated system that compares a fingerprint query (typically a latent print from a crime scene) against a reference database to identify...
- Clearview AI
- New York company that built a face-recognition database of approximately 30 billion images scraped from public websites without consent; subject to BIPA...
- Cumulative Disadvantage
- The compounding of small disadvantages at successive decision points so that the gap in final outcomes is larger than the gap at...
- Daubert Standard
- The US federal evidentiary standard (Daubert v. Merrell Dow Pharmaceuticals, 1993) requiring that expert testimony be based on scientifically valid methods with...
- Disproportionate Minority Contact
- A situation where a group's share of contact with police, courts, or corrections exceeds its share of the general population, used especially...
- EU AI Act Art 10 (Training Data Requirements)
- Provision requiring that training, validation, and testing datasets for high-risk AI systems be relevant, representative, free of errors, and complete, with appropriate...
- False-Positive Rate (FMR)
- In biometric verification: the probability that a comparison of images of two different individuals is incorrectly declared a match. In forensic identification,...
- Fitzpatrick Scale
- A skin-tone classification system originally developed by dermatologist Thomas B. Fitzpatrick in 1975 (initially covering four types for UV response in phototherapy),...
- Gender Shades (2018)
- Study by Joy Buolamwini and Timnit Gebru published at FAccT 2018 that measured accuracy disparities in three commercial face-recognition APIs across intersectional...
- Implicit Bias
- An automatic, often unconscious association between a social category and a trait or evaluation, which can shape a decision without the decision-maker...
- NIST FRVT (Face Recognition Vendor Test)
- Ongoing NIST evaluation of commercial face-recognition algorithms, with the 2019 Demographic Effects report covering 189 algorithms from 99 developers; confirms Gender Shades...
- Robert Williams Case (2020)
- First publicly documented wrongful arrest in the US attributed to a face-recognition false positive: Detroit police arrested Robert Williams, a Black man,...
Explained in these topics
- Bias and Disparate Impact in Face and Fingerprint Matching
- Disparity and Discrimination in the Criminal Justice SystemA facially neutral rule or practice that produces a materially different outcome rate across groups, regardless of whether anyone intended that result.