Findings
CADe clinical performance studies must address key variables, including reader variability, disease prevalence, and device design differences.
Properly conducted MRMC studies are critical for assessing diagnostic effectiveness, incorporating both unaided and aided reading conditions.
Enriched datasets, while useful for stress testing, must be carefully designed to avoid bias and reflect intended use populations.
The truthing process (establishing reference standards) is essential to validate device performance claims and should be rigorously defined.
The FDA encourages pre-specification of hypotheses, statistical methods, and endpoints to ensure robust and interpretable results.

Recommendations
Design studies with representative patient populations and include diverse subgroups relevant to the device’s intended use.
Use validated statistical methods for MRMC analyses, reporting sensitivity, specificity, and receiver operating characteristic (ROC) curve metrics.
Develop and document a detailed truthing process for establishing reference standards, ensuring consistency and reliability.
Conduct stress testing with enriched datasets to evaluate device performance under challenging conditions but avoid overrepresenting certain subsets.
Submit a complete study protocol and statistical analysis plan, including sample size justification, randomization methods, and scoring techniques.

Regulatory Considerations
CADe devices classified under 21 CFR 892.2050 or 892.2070 must comply with premarket notification requirements, including performance testing and labeling.
Standalone performance assessments may suffice in certain scenarios, but clinical studies are often necessary for substantial equivalence determinations.
Use of foreign clinical data requires justification of its applicability to U.S. populations and medical practice.
FDA expects data integrity controls, such as firewalls and audit trails, to prevent tuning bias in test datasets reused across studies.
The FDA encourages early engagement (e.g., Pre-Submission requests) for feedback on study protocols and regulatory pathways.