ACE-V Methodology and the Brandon Mayfield Madrid Bombing Error

ACE-V stands for Analysis, Comparison, Evaluation, and Verification. The Scientific Working Group for Friction Ridge Analysis, Study and Technology (SWGFAST) published the methodology's foundational documents before being succeeded by the OSAC Friction Ridge Subcommittee in 2015.

Analysis is the first phase, and it is the one most often compressed or skipped under casework pressure. The examiner works from the latent print in isolation, before looking at any exemplar. The goal is to characterise everything the latent can tell you:

• Quality and pressure distortion
• Level of detail visible (Level 1 pattern type, Level 2 minutiae positions and types, Level 3 pore and edge-contour detail where resolution permits)
• Any artefacts that could be mistaken for ridge detail

The analyst records what they see before they have a suspect. In practice, many laboratories did not enforce this documentation requirement, and examiners moved directly from receiving the latent to comparing it against a named suspect's ten-print record.

Comparison is the second phase. The examiner places the latent and the exemplar in correspondence, aligns them to the same region, and systematically works through the points of similarity and difference. The comparison is driven by what the analyst documented in Phase 1.

Evaluation is the third phase. The examiner reaches one of three conclusions:

• Identification: the latent and the exemplar originated from the same source, to the practical exclusion of all others
• Exclusion: they did not originate from the same source
• Inconclusive: the quality or quantity of corresponding detail is insufficient to reach either conclusion

Historically, the most contentious feature of this phase was the implicit claim attached to "identification": that the error rate was effectively zero.

Verification is the fourth phase. An independent examiner repeats the ACE process without knowing the conclusion reached by the original examiner and records their own conclusion before any comparison with the first.

The latent print from the Madrid blue bag was of modest quality. It showed a fragmented loop pattern with a limited but workable number of minutiae visible at Level 2. The IAFIS candidate list returned several candidates; Mayfield appeared in the top twenty. The examiner who first reviewed the list was already aware that Mayfield was a person of interest to the FBI's counterterrorism division before he began his comparison.

The FBI Office of Inspector General (OIG) report, published in November 2006, reconstructed the sequence in detail. The first examiner found what he judged to be fifteen points of correspondence. He ignored or explained away features that did not match. One area showed a ridge flow that appeared inconsistent with Mayfield's ten-print record; the examiner attributed the discrepancy to pressure distortion on the latent. Two senior examiners conducted their own comparisons and reached the same identification conclusion.

The Spanish National Police had also run their own comparison and reached a different conclusion: the latent did not match Mayfield. They transmitted this finding to the FBI, who responded that they remained confident in their identification. The Spaniards ran additional work and identified the actual source as Daoud, an Algerian national whose prints were on file from a prior investigation. Only then did the FBI withdraw its identification and release Mayfield.

The OIG report identified three primary causes:

1. Confirmation bias: each subsequent examiner knew that the first had reached an identification, which anchored their own analysis. The verification phase, which was supposed to be independent, was not operationally independent.
2. Over-weighting similarities: examiners explained away discrepancies rather than treating them as evidence against the match.
3. Contextual contamination: information about Mayfield's religion, his legal representation of a terrorism suspect, and his counterterrorism status had contaminated the analysis before it began.

Mayfield sued the US government. The case was settled in 2006 for two million US dollars and a formal written apology from the FBI.

Twelve years before Mayfield, a Scottish police officer named Shirley McKie became the subject of a contested fingerprint identification that destroyed her career and her health, one of several major fingerprint error cases from the same era. In 1997, four examiners at the Scottish Criminal Record Office (SCRO) concluded that a fingerprint found inside the Marion Ross murder scene belonged to McKie, who denied ever having been in the house. McKie was charged with perjury. American experts Pat Wertheim and David Grieve concluded the SCRO identification was wrong. The perjury charge was eventually dropped; the Scottish Executive paid McKie compensation of GBP 750,000 in 2006. The Fingerprint Inquiry Scotland (2011), chaired by Sir Anthony Campbell, concluded the SCRO examiners had made a genuine error and that contextual bias had played a role.

In the United States, the National Academy of Sciences 2009 report "Strengthening Forensic Science in the United States" catalogued documented fingerprint errors from US courts and concluded that the categorical zero-error-rate claim was empirically unsupported. The Ulery et al. 2011 study, commissioned by the FBI in direct response to the NAS report, tested 169 latent print examiners on 744 latent-exemplar pairs:

• False-positive rate (incorrectly calling an exclusion pair an identification): 0.1%
• False-negative rate (incorrectly calling an identification pair inconclusive or an exclusion): substantially higher

These were not zero. See the 2009 NAS critique of fingerprint individualization for the full policy context.

In India, the CFSL and state FSL fingerprint divisions have operated under the Indian Evidence Act section 45 (expert opinion) since 1872, and now under the Bharatiya Sakshya Adhiniyam 2023. Indian courts have periodically addressed contested fingerprint evidence, including in cases before the Madras High Court and the Supreme Court, where comparison quality and methodology have been placed in issue. The Mahalakshmi 2018 Tamil Nadu case and Karnataka High Court precedents from 2019 both addressed the requirements for fingerprint evidence to satisfy BSA 2023 section 45's expert-opinion admissibility standard. Across the US, UK, and Indian contexts, the remedial need is the same: structural protections built into the methodology before an opinion is formed, not after.

Sequential unmasking, articulated by cognitive psychologist Itiel Dror and adopted into laboratory protocols by the FBI and the UK Forensic Science Regulator by the mid-2010s, is a management protocol rather than a technical one. The principle: information about a case should flow to the examiner only in the sequence in which it is needed, and only in the amount required for each phase.

In practice, the latent print arrives at the examiner's desk without any candidate name, without contextual information about the crime, and without any pre-existing conclusion from another examiner. The examiner documents their analysis of the latent, recording features and quality assessment. Only after this documentation is completed and signed off does the examiner receive the candidate's exemplar for comparison.

This sequence addresses two of the three Mayfield OIG causes: it prevents contextual contamination of the Analysis phase, and it commits the examiner to a feature inventory before they know who they are comparing against.

Linear ACE-V, codified in the FBI's Quality Assurance Standards for Latent Print Examination, enforces the four phases as discrete, documented steps that must be completed in order:

• An examiner cannot proceed to Comparison without a completed and documented Analysis.
• An examiner cannot proceed to Evaluation without a completed Comparison.
• Each phase has a documented record that can be reviewed, audited, and placed in evidence.

Blind verification addresses the third Mayfield OIG cause: the verifier should not know the original examiner's conclusion before completing their own ACE phases.

• The UK Forensic Science Regulator's Codes of Practice (FSR-C-128, 2020 edition) require blind verification as the default for identification conclusions.
• The ENFSI Fingerprint Working Group Best Practice Manual (2015, revised 2022) recommends the same.
• The FBI QAS for Latent Print Examination requires blind verification for all identification conclusions and for inconclusive conclusions that are to be reported.

The relationship between bias research and these reforms is examined in depth in the Dror 2006 cognitive bias study and the bias mitigation toolkit.

In the United States, the primary standard documents are:

• FBI Quality Assurance Standards for Latent Print Examination (2022 edition)
• OSAC Friction Ridge Subcommittee standard OSAC 2021-S-0007
• Scientific Area Committee reports on error rate and contextual bias (2016-2022)

Together, they require documented sequential analysis before candidate disclosure, linear phase progression with records at each phase, blind verification for identification and inconclusive-for-reporting conclusions, and explicit prohibition on accessing prior identification conclusions before completing independent analysis.

In the United Kingdom, the Forensic Science Regulator's Codes of Practice and Conduct (FSR-C-128) are the operative standard. The FSR requires sequential unmasking, blind verification, and the evaluative reporting framework (which expresses conclusions as a likelihood ratio or graduated verbal scale rather than categorical identification). UK courts apply gatekeeping scrutiny through R v. Turner (1975), which established the necessity test for expert evidence admissibility.

In Europe, the ENFSI Fingerprint Working Group's Best Practice Manual covers ACE-V methodology, evaluative reporting, and blind verification. ENFSI member laboratories operate under national accreditation bodies (DAkkS in Germany, RvA in the Netherlands, COFRAC in France, UKAS in the UK) that conduct surveillance audits against ISO/IEC 17025.

In India, the CFSL fingerprint methodology aligns with the Directorate of Forensic Science Services (DFSS) standard operating procedures and NABL T-126 accreditation criteria. The NCRB NAFIS technical documentation references ACE-V as the examination standard for all latent-print comparisons involving NAFIS candidates. The BSA 2023 framework, like the earlier Indian Evidence Act section 45, requires that fingerprint expert opinion be grounded in a demonstrable, reproducible method.

For the admissibility standards underpinning these requirements across jurisdictions, see standards, accreditation and admissibility in fingerprint evidence.

The Dror 2006 cognitive bias study, published in the Journal of Forensic Sciences, was the first controlled experiment to demonstrate that experienced fingerprint examiners would change their identification decisions when given misleading contextual information. Dror took five experienced examiners and showed them the same prints they had themselves previously examined and decided in a real case, but embedded in a new context: one group was told the prints had led to a misidentification (the Mayfield narrative), another was shown them in a neutral context. Four of the five examiners changed their conclusions. They were not aware they were looking at the same prints.

Dror and Charlton extended this in a 2006 follow-on study, and subsequent work by Dror and colleagues from 2008 through 2020 has consistently shown that fingerprint examination conclusions are susceptible to anchoring, framing, and authority effects. The FBI Laboratory's own black-box study (Ulery et al. 2011) confirmed that error rates were not zero. The PCAST report of 2016 (President's Council of Advisors on Science and Technology, "Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods") concluded that fingerprint examination had a valid scientific foundation but required further error-rate research and urged the establishment of robust sequential unmasking and blind verification procedures, arguments that built directly on the 2009 NAS critique of fingerprint individualization.

The response from the fingerprint community has been substantive. The FBI Laboratory adopted linear ACE-V and sequential unmasking protocols between 2006 and 2012. The UK FSR made blind verification a formal requirement in the 2014 Codes of Practice revision. The ENFSI Fingerprint Working Group embedded contextual-bias management into its 2015 Best Practice Manual. The International Association for Identification (IAI), which governs the Latent Print Certification programme, addressed bias management in its 2018 and 2022 certification requirements.

The open research questions now cluster around three areas. First, how much contextual information is unavoidable in casework, and how should that information be managed rather than simply prohibited? Second, what is the optimal blind-verification workflow for high-volume laboratories where resource constraints are real? Third, how should the documented error rate inform the strength of fingerprint evidence in court, and how should that strength be communicated to a jury that has been told for a century that fingerprint identification is infallible?

These questions are being addressed simultaneously in the US by the OSAC Friction Ridge Subcommittee, in the UK by the Forensic Science Regulator's ongoing Codes of Practice revision cycle, and in Europe by the ENFSI research programme. The Mayfield error was a catastrophic failure that produced a research and reform programme whose depth the discipline had never previously had to confront.