Cross-tab method (each line: appraiser judgment reference/standard judgment)
Multi-trial signal detection (each line: name type m n)
🤖 AI Interpretation
AI is analyzing, please wait…
Judgment logic (AIAG MSA attribute)
· Effectiveness: cross-tab gives effectiveness = correct judgments / total; false-alarm PFA (good judged bad); missed-alarm PM (bad judged good).
· Acceptance: effectiveness >=90% acceptable, 80-90% conditional, <80% unacceptable; false alarm <=5%; missed alarm <=2% (strictest for key characteristics).
· Multi-trial: repeat known standard parts m times; use the 95% one-sided upper bound (Wilson) to test false-alarm rate <=5% / missed-alarm rate <=2%.
· Complements Kappa: Kappa measures agreement; this tool measures detection capability.