RESEARCH INTO PRACTICE / Verification and information
What makes verification independent?
A second opinion becomes more informative when we can distinguish what the verifier recorded independently from what followed disclosure of the first examination.
In this article
What did the verifier conclude before seeing the first account?
Imagine a verifier who examines a pair of impressions, records the detail they consider significant and submits an opinion. They then open a colleague’s examination of the same material. Some observations agree; others draw attention to areas they had interpreted differently. After review, the verifier supports the colleague’s conclusion with a qualification.
That sequence contains two useful accounts: the verifier’s initial examination and their response to another person’s work. If the record retains only the final agreement, it becomes difficult to tell whether the examiners independently selected similar detail or whether the second account developed after seeing the first.
Independence therefore needs a practical description. What material had the verifier encountered? Which findings were available? When did that information become accessible? These questions help establish the conditions under which the second opinion was formed.
The information surrounding an opinion matters
The NIST human-factors report treats verification within a wider system of examination, documentation and reporting. Its recommendations include stating whether verification occurred and whether a conflict of opinion preceded the reported conclusions. A resolved difference remains relevant to understanding how the reported account was reached.[1]
The later LSU-E implementation paper by Quigley-McBride and colleagues addresses how laboratories can organise information before and during an examination. It discusses the influence of knowing a colleague’s conclusion and presents a worksheet for considering information sources, relevance, objectivity and biasing potential. The practical question is when particular information should enter the decision process.[2]
The NIST human-factors work was among the research foundations of PROFAS, which I began building in 2017. The LSU-E paper is newer work encountered during the current project. It extends the information-management discussion; it does not establish that a particular software workflow has reduced bias.
Separate examinations can still share a difficulty
There is also a statistical distinction. Keeping examiners unaware of one another’s findings does not make all their possible errors independent. Both may encounter the same difficult or misleading detail in the material.
Ulery and colleagues illustrated this in their 2011 fingerprint decision study. When considering the potential for blind verification to detect erroneous exclusions, they found that some mated image pairs were more likely to attract exclusions than others. Multiplying the overall individual error rate by itself did not describe the observed joint outcomes appropriately.[3]
That analysis used independently collected responses to investigate potential verification benefits. It was not a direct evaluation of a complete operational verification policy. A protected initial examination gives researchers a better-defined condition to study, while the effectiveness of a review arrangement still depends on the material, participants and procedure.[3]
How PROFAS preserves the verifier’s starting point
In PROFAS, a verification assignment identifies another examiner’s exact submitted Evaluation. The verifier supplies their own completed Evaluation as a baseline. Eligibility checks include authorship, the same pinned material and protocol, compatible module definitions and a declaration of no prior exposure. Recorded earlier encounters, source preparation and overlapping source identities also matter.
An eligible baseline is sealed to the assignment before the target findings are released. The baseline can reference an earlier eligible examination; reuse remains visible and does not create another independent examination each time that record supports a review.
Changing the identifier of a material set does not erase familiarity with its sources. Eligibility follows item and specimen relationships as well as source hashes. Unknown exposure is also different from a declaration of none. These distinctions give an administrator reasons to resolve the intended condition rather than treating every completed examination as an independent starting point.
Release and opening have separate records. An administrator releases the exact target, fixing its relationship to the baseline and the material disclosed. The verifier then explicitly opens that disclosure. Release records availability; opening records the workflow event that provides access. Neither event measures how carefully the verifier read the findings.
The later report addresses observations, interpretations, reasoning, the conclusion, limitations and changes after disclosure. It cites exact contributions in the fixed target or baseline. A subsequent amendment by the original examiner does not silently replace the assigned target. This preserves the relationship between the two initial accounts and the later review.
Verification guidance has a defined scope
ANSI/ASB Standard 102 provides a useful current example for firearm and toolmark work. Its 2025 first edition concerns verification of source conclusions from toolmark comparisons, including inconclusive opinions. It requires a provider’s risk assessment to determine the portion protected from prior knowledge of the primary conclusion and task-irrelevant information.[4]
It also addresses item identity, disagreement resolution and retained documentation. An outside expert should be able to follow the original, intermediate and final conclusions of each examiner. Alternative methods such as virtual review are conditional on their sufficiency, and physical evidence must be available at the verifier’s request.[4]
Those are discipline-specific requirements for a service provider’s process. They should not be presented as universal verification guidance or as certification of PROFAS. Preserving separate accounts can support scrutiny of a procedure, while the laboratory remains responsible for the procedure and the conditions under which it is used.
A recorded boundary supports investigation
Software can check recorded encounters and control access through its own routes. It cannot establish everything a person previously saw in another system, heard in conversation or learned outside the study. Exposure declarations and organisational arrangements remain part of interpreting an independent baseline.
The resulting record lets a researcher ask more specific questions. Where did the initial observations agree? Which differences remained after disclosure? Did the verifier revise an interpretation, identify a limitation or agree with the conclusion for different reasons? Agreement with a conclusion can coexist with reservations about an observation or its explanation. The aim is to preserve the evidence needed to investigate verification, with its conditions and limits visible.
FOLLOW THE EVIDENCE
Sources & further reading
The original research behind this article.
- Expert Working Group on Human Factors in Latent Print Analysis (2012). Latent Print Examination and Human Factors: Improving the Practice through a Systems Approach. NISTIR 7842. NIST and NIJ.(opens in a new tab)
Recommendation 5.2 includes reporting verification and conflicts preceding the reported conclusions.
Back to the article - Quigley-McBride, A., Dror, I. E., Roy, T., Garrett, B. L., and Kukucka, J. (2022). A practical tool for information management in forensic decisions: Using Linear Sequential Unmasking-Expanded (LSU-E) in casework. Forensic Science International: Synergy, 4, 100216.(opens in a new tab) Back to the article
- Ulery, B. T., Hicklin, R. A., Buscaglia, J., and Roberts, M. A. (2011). Accuracy and reliability of forensic latent fingerprint decisions. Proceedings of the National Academy of Sciences, 108(19), 7733–7738.(opens in a new tab) Back to the article
- AAFS Standards Board (2025). Standard for Verification of Source Conclusions in Toolmark Examinations. ANSI/ASB Standard 102, first edition.(opens in a new tab)
Toolmark source conclusions; scope and requirements in sections 1 and 4.
Back to the article