Black-Box Validation
Definition
A study design where examiners are given unknown questioned-vs-known pairs and asked to match or exclude without feedback, allowing error rates to be measured directly.
Related terms
- AFTE Theory of Identification
- The Association of Firearm and Tool Mark Examiners' standard (1992, revised 2011) for reporting tool-mark comparison conclusions as Identification, Inconclusive, or Elimination...
- Asperity
- A microscopic surface protrusion on a tool's cutting edge; each asperity produces a groove in the substrate when the tool slides, contributing...
- Class Characteristics
- Features deliberately or systematically imparted to a group of items by design or manufacture, such as the calibre of a bullet, the...
- False-Positive Rate
- The proportion of authentic media files that a detection tool incorrectly classifies as manipulated or synthetic. Deepfake detectors and ELA tools both...
- Impressed Mark
- Also called indented or compression mark. Tool is pressed perpendicularly into the softer surface and reproduces the contour of the tool's working...
- Individual Characteristics
- Surface features on a fired bullet or cartridge case that arise from random or unique events (tool wear, corrosion, service damage) and...
- OSAC (NIST)
- Organization of Scientific Area Committees for Forensic Science under the US National Institute of Standards and Technology; the successor body to SWGDOC,...
- PCAST 2016
- President's Council of Advisors on Science and Technology 2016 report 'Forensic Science in Criminal Courts', which assessed foundational validity of forensic disciplines...
- Shear Zone
- The region of a bolt-cutter or wire-cutter mark showing striations from the blade edge sliding across the cut face; the highest individual-characteristic-content...
- Striated Mark
- Also called scratch, abrasion or scrape mark. Tool slides laterally across the surface and leaves parallel striations from microscopic imperfections on the...
- Subclass Characteristics
- Features shared by a subset of tools from the same production run; must be distinguished from individual characteristics before an identification opinion...
Explained in
- Tool Marks: Fundamentals, Striations and ImpressionsA study design where examiners are given unknown questioned-vs-known pairs and asked to match or exclude without feedback, allowing error rates to be measured...