NIST FRVT
Definition
The National Institute of Standards and Technology Face Recognition Vendor Testing programme, the primary independent benchmark for facial recognition algorithms, publishing ongoing accuracy reports covering dozens of commercial and academic systems.
- Organization
- US National Institute of Standards and Technology (NIST)
- Program type
- Ongoing independent algorithm evaluation and benchmarking
- Coverage
- Dozens of commercial and academic facial recognition systems
Common questions
What does NIST FRVT test in facial recognition systems?+
NIST FRVT evaluates facial recognition algorithms on accuracy and fairness. It tests both 1:1 verification (checking if two photos match the same person) and 1:N identification (searching a database to find who is in a photo). The program also measures demographic performance differentials to spot accuracy gaps across different groups.
Why do forensic investigators care about NIST FRVT benchmarks?+
NIST FRVT provides independent accuracy data on commercial and academic facial recognition systems. Knowing how a system performed in published tests helps investigators understand its reliability and limitations when used in casework. It also documents how algorithm performance varies with image quality and demographic factors, which is critical for courtroom testimony.
Does NIST FRVT test real-world crime scene photos?+
Yes. The testing program includes CCTV image performance evaluations, so it assesses how algorithms handle the kinds of low-resolution, angled, and poor-lighting photos collected at crime scenes. This real-world testing makes the results more useful for forensic practitioners than lab-only benchmarks.
Related terms
- Aadhaar
- India's national biometric identity programme, administered by UIDAI. Links a 12-digit UID to 10 fingerprints, iris scans, and a facial photograph for...
- AFRS (India)
- Automated Facial Recognition System, the face recognition module within India's CCTNS, operated by the NCRB and used for searching against mug shots,...
- ArcFace / FaceNet
- Two influential deep CNN facial recognition architectures. FaceNet (Google, 2015) used a triplet-loss training approach to learn facial embeddings. ArcFace (Deng et...
- BIPA
- Illinois Biometric Information Privacy Act (740 ILCS 14, 2008). Requires informed written consent before collecting biometric identifiers and prohibits their sale. The...
- Clearview AI
- New York company that built a face-recognition database of approximately 30 billion images scraped from public websites without consent; subject to BIPA...
- Deep Convolutional Neural Network (DCNN) Embedding
- The face descriptor produced by a neural network trained to map face images into a metric space where same-person images cluster together;...
- Embedding
- A compact numerical vector representation of a face produced by a neural network. The distance between two embeddings in the vector space...
- ENFSI BPM
- The ENFSI Best Practice Manual for Forensic Comparison of Speech (2015, rev. 2022); the operational standard for speaker comparison in European forensic...
- False Match Rate (FMR)
- The proportion of non-mate comparisons (different individuals) that the system incorrectly scores as a match. Also called the false positive rate or...
- False Non-Match Rate (FNMR)
- The proportion of mate comparisons (same individual) that the system incorrectly scores as non-matching. Also called the false negative rate. A lower...
- False Positive Identification Rate (FPIR)
- In 1:N identification, the rate at which a probe image of an individual not in the gallery generates a top-rank match. Critical...
- Gallery Vs. Probe
- In facial recognition, the gallery is the reference database of enrolled face images; the probe is the query image being compared against...
Explained in these topics
- Automated Facial Recognition: Role, Accuracy, and LimitationsThe National Institute of Standards and Technology Face Recognition Vendor Testing programme, the primary independent benchmark for facial recognition algorith...
- Face Recognition: NIST FRVT, FBI NGI and Forensic Facial ComparisonFace Recognition Vendor Test, NIST's ongoing programme of independent algorithm evaluation covering 1:1 verification and 1:N identification accuracy, demograph...
- Major Biometric Casework: Golden State Killer and Clearview AIUS National Institute of Standards and Technology Face Recognition Vendor Test; the primary public benchmark for facial recognition algorithm accuracy, includi...