标准摘要
[中文适用范围]: 本文件建立了要求,用于估计和报告在不同 demographic 组中使用生物识别 enrolment 和 recognition 系统时观察到的性能差异。在这种情况下,性能是指拒绝 enroll 的比例、拒绝获取的比例、比较分数的变化、识别错误率以及响应和处理时间(吞吐量)方面的变化。 本文件适用于以下情况:- demographic 组成员资格;- 使用表型测量;- 报告测试结果;- 声明统计不确定性估计;- 运行阈值设置;- 公平性;- 采购机构活动。 本文件还提供了在报告不同 demographic 组性能差异时使用的术语和定义。 本文件适用于:- 算法、子系统和系统的技术评估;- 系统的场景评估;- 已部署系统的运行评估。 本文件的应用不需要对系统算法的详细了解,但它确实需要特定了解感兴趣人群的 demographic 特征。 [外文原描述]: This document establishes requirements for estimating and reporting on performance variations observed when cohorts belonging to different demographic groups engage with biometric enrolment and recognition systems. In this context, performance refers to failure-to-enrol rate, failure-to-acquire rate, shifts in comparison score, recognition error rates, and aspects of response and processing time (throughput). This document is applicable to the following: — demographic group membership; — using phenotypic measures; — reporting on tests; — stating statistical uncertainty estimates; — operational thresholds settings; — equitability; — procurement agency activities. This document also provides terms and definitions to be used when reporting performance variation across demographic groups. This document is applicable to: — technology evaluations of algorithms, subsystems and systems; — scenario evaluations of systems; — operational evaluations of fielded systems. Application of this document does not require detailed knowledge of a system’s algorithms but it does require specific knowledge of the demographic characteristics for the population of interest.
英文名称Information technology - Biometric performance testing and reporting - Part 10: Quantifying biometric system performance variation across demographic groups