NA

Findings
Fragmented and inconsistent measurement approaches currently hinder the generation of decision-grade evidence for pediatric rare diseases. Small and geographically dispersed patient populations make traditional site-based clinical assessments operationally difficult and burdensome for families. Digital health technologies can capture subtle functional changes and "functional fingerprints" in home settings that are often missed during infrequent clinic visits. Standardized core digital measures across conditions allow for the aggregation of data and the creation of a shared evidence base for rare disorders. Meaningful aspects of health identified by patients and caregivers include motor function, communication, sleep quality, and autonomic stability.

Recommendations
Sponsors should adopt the core set of digital clinical measures to reduce trial timelines, lower development costs, and decrease participant burden. Researchers should prioritize passive and objective data collection to minimize the need for manual tracking by caregivers. Clinical trial designs should transition toward decentralized or hybrid models to improve access for children and families regardless of their location. Stakeholders should use the project's conceptual model to identify and customize digital measures that align with the specific health priorities of their target population. Developers should focus on human-centered design to ensure digital tools are usable and sustainable for pediatric patients and their support networks.

Regulatory Considerations
The FDA and EMA provide specific pathways and interaction opportunities to accelerate the acceptance of digital endpoints in rare disease trials. Digital measures must be validated as "decision-grade" endpoints to meet the evidentiary requirements for regulatory submission and marketing approval. Alignment with industry standards for data elements and interoperability is necessary to ensure data integrity across multi-site studies. Early engagement with regulatory bodies through meetings and formal submissions is critical for confirming the suitability of new digital biomarkers. Compliance with data privacy and ethical standards is paramount when collecting continuous, real-world data from vulnerable pediatric populations.

Findings
Establishing cross-sector consortia does not guarantee success without a unified objective and stakeholder buy-in. A neutral, independent facilitator is a key element for successful governance in many collaborative platforms. Many consortia lack consistent methods for storing critical data, meeting minutes, and regulatory briefing packages, which creates barriers after project completion. Regulatory success depends heavily on the early development of a strategy that defines the necessary evidence to validate innovative methodologies. Successful examples include the qualification of biomarkers for polycystic kidney disease and type 1 diabetes, as well as imaging measures for Alzheimer’s disease.

Recommendations
Consortium members should develop an initial regulatory strategy during the project scoping and planning phases. Teams must explicitly define the context of use for any proposed tool to articulate exactly what decisions the output will inform. A robust data strategy should be implemented early, including formal agreements for data use, standardization, and sharing that remain in place in perpetuity. Consortia must prioritize sustainability plans to ensure data and active databases remain available for research and regulatory use after funding expires. Projects should integrate regulatory science expertise from the start to cover both EU and US frameworks.

Regulatory Considerations
Regulators require individual patient-level data that is fully curated, standardized, and presented through formal submissions like qualification applications. Formal regulatory endorsement ensures a tool can be trusted for consistent interpretation in drug development and marketing authorization evaluations. Early engagement with agencies such as the FDA and EMA is essential to gain feedback on novel methodologies and align study designs with regulatory expectations. Specific pathways like the EMA Qualification of Novel Methodologies and the FDA Qualification Process for Drug Development Tools should be utilized. Regulatory qualification may require ongoing access to databases to support the long-term use of the methodology.

Key Principles (Findings)
The central principle of the FDA's program is that Digital Health Technologies (DHTs) offer significant potential to make clinical trials more efficient, patient-centric, and capable of capturing novel data. A key finding is that a collaborative, multifaceted approach is necessary to address the challenges of incorporating DHT-derived data into regulatory decision-making. The program acknowledges that ensuring data quality, validating new endpoints, and establishing clear regulatory expectations are critical for the successful adoption of these technologies in drug development.

Program Activities (Recommendations)
The FDA's activities in this area function as implicit recommendations for the industry. The agency is actively:
Developing a Framework: Creating and publishing a clear framework to guide the use of DHTs in drug and biological product development.
Engaging Stakeholders: Convening public meetings and workshops to foster collaboration and share learning among patients, biopharmaceutical companies, DHT manufacturers, and academia.
Supporting Demonstration Projects: Funding and overseeing research projects to address critical gaps and demonstrate the reliability and validity of specific digital measures.
Building Internal Expertise: Establishing a DHT Steering Committee and enhancing internal knowledge to ensure consistent and expert review of submissions containing DHT-derived data.

Regulatory Considerations
This webpage emphasizes the FDA's commitment to creating a clear regulatory framework for the use of DHTs in drug development. It highlights that while DHTs offer great promise, they also present new regulatory challenges related to data integrity, validation, and analysis. The FDA's approach involves a combination of issuing new regulatory guidance, promoting stakeholder collaboration, and advancing regulatory science. Sponsors are encouraged to engage with the FDA to discuss their use of DHTs in clinical trials to ensure alignment with the agency's expectations. The establishment of the CDRH Digital Health Center of Excellence provides a dedicated resource for such engagement.

Findings
Traditional, site-based clinical trials often create significant burdens for participants, which can hinder recruitment, retention, and the enrollment of diverse populations.
A lack of early and sustained patient engagement in trial design can lead to research protocols that are misaligned with patient needs and endpoints that are not meaningful to them.
The underrepresentation of diverse racial, ethnic, and other demographic groups in clinical trials limits the generalizability of study results and can perpetuate health disparities.
Emerging digital health technologies (DHTs) and real-world data (RWD) present significant opportunities to make clinical trials more efficient, patient-centric, and inclusive, but their adoption has been inconsistent.

Recommendations
Sponsors and research teams should engage patients and patient advocacy groups as active partners throughout the entire clinical trial lifecycle, from design to dissemination.
Decentralized clinical trial (DCT) elements should be incorporated to reduce patient burden, improve access for diverse populations, and enhance the quality of data collection.
Trial sponsors must develop and implement proactive strategies to enhance the diversity and inclusion of trial participants to ensure results are applicable to all patient populations.
Novel endpoints derived from DHTs should be developed and validated to capture more objective, real-world measures of how patients feel, function, and survive.
Multi-stakeholder collaboration between industry, academia, patient groups, and regulators is essential to address systemic challenges and improve the clinical trial enterprise.

Regulatory Considerations
Early and frequent communication with regulators, such as the FDA, is critical when implementing novel approaches like DCTs or developing new digital endpoints for pivotal trials.
Regulatory frameworks must support the use of innovative technologies and trial models while ensuring data integrity, reliability, and patient safety.
The use of a single Institutional Review Board (IRB) for multi-site trials is a key regulatory-supported mechanism for streamlining ethics review and increasing trial efficiency.
When using DHTs and decentralized methods, robust plans for data quality, privacy, and security are necessary to meet regulatory standards for trial data submission.

Findings
The guidance applies to four types of Clinical Outcome Assessments (COAs): Patient-Reported Outcomes (PROs), Observer-Reported Outcomes (ObsROs), Clinician-Reported Outcomes (ClinROs), and Performance Outcomes (PerfOs). A COA is considered fit-for-purpose when the validation evidence is sufficient to support its context of use (COU). To determine if a COA is fit-for-purpose, sponsors must clearly describe the Concept of Interest (COI) and the COU, and present sufficient evidence to support a clear rationale for the COA's proposed interpretation and use. The rationale for using a COA should include up to eight components, such as justification for the COA type, capturing the important parts of the COI, appropriate administration and scoring, minimal influence from irrelevant factors or measurement error, and correspondence with the Meaningful Aspect of Health (MAH). The most direct assessment of how a patient feels or functions (MAH) should be used as the COI whenever possible.

Recommendations
Sponsors should use the Roadmap to Patient-Focused Outcome Measurement to guide the selection, modification, or development of a COA. The process begins with understanding the disease/condition (including patient perspectives) and conceptualizing clinical benefits and risks (defining the MAH, COI, and COU). When feasible, existing COAs are generally preferred, especially for well-established COIs, as this approach is often the least burdensome. If an existing COA is modified or used in a different context, additional evidence (e.g., cognitive interviews, psychometric studies) must be collected to justify its fitness for the new context of use. For new COA development, sponsors should involve patients, document all steps, and generally avoid using the new COA for the first time in a registration (pivotal) trial; a standalone observational study or early phase trial is recommended for evaluation.

Regulatory Considerations
Sponsors are encouraged to interact early and throughout medical product development with the relevant FDA review division to ensure COAs are appropriate for the intended COU. Sponsors should communicate their proposed COA-based endpoint approach, including the MAH, COI, COA type/name/score, and the final COA-based endpoint, ideally using the suggested format. The type and amount of evidence required to support the rationale for a COA's use is weighed against the degree of uncertainty regarding that part of the rationale. For ClinROs, it is recommended to use an assessor masked to treatment assignment and study visit for primary endpoints, if feasible. FDA strongly discourages proxy-reported measures for concepts known only to the patient (e.g., pain) and recommends using an ObsRO to measure observable behaviors instead when the patient cannot self-report.

Recommendations
Clearly define the concept of interest and its context of use to ensure COAs align with trial objectives.
Use conceptual and measurement frameworks to communicate how COAs measure patient experiences and generate interpretable scores.
Leverage existing COAs where possible, modifying them only when justified, and document all modifications rigorously.
Ensure COAs are accessible and inclusive, incorporating features like large fonts, touch interfaces, or audio assistance for diverse populations.
Conduct early engagement with FDA to discuss COA selection, development, and validation plans.

Regulatory Considerations
Fit-for-purpose validation requires evidence of conceptual alignment, scoring reliability, and sensitivity to clinically meaningful changes.
Digital health technologies used for COAs must comply with FDA’s guidance on data integrity, usability, and technical performance.
COAs intended for regulatory submissions must be developed and validated before pivotal trials to avoid jeopardizing trial outcomes.
Modifications to COAs or scoring methods during trials necessitate justification and revalidation.
Sponsors should submit comprehensive documentation on COA development, including scoring algorithms and item tracking matrices.

Findings
Challenges in patient adherence and acceptability of digital endpoints.
Issues with algorithm validation and use in diverse populations.
Barriers due to proprietary software and lack of transparency.
Vast heterogeneity in digital endpoints and lack of standards.
Need for ongoing ethical support and consideration of environmental impact.

Recommendations
Foster multi-stakeholder cooperation and open-forum discussions.
Integrate patient needs into the design of digital health technologies.
Include implementation science expertise in research proposals.
Develop standards for selecting and reporting digital endpoints.
Provide ongoing ethical support throughout the research lifecycle.

Regulatory Considerations
Early engagement with regulators is crucial.
Understanding regulatory requirements for clinical trials versus clinical care.
Need for harmonised terminology and guidelines for digital endpoints.

Findings
A proactive risk assessment is essential for optimizing study quality by identifying and mitigating risks to human subject protection and data integrity before and during a trial. Monitoring should be comprehensive, addressing not only likely risks identified initially but also less probable, high-impact risks and unanticipated issues that emerge. The effectiveness of a monitoring strategy depends on tailoring its timing, frequency, and methods to study-specific factors like complexity and site experience. Centralized monitoring, as part of a risk-based approach, can detect systemic issues like data omissions or protocol deviations more rapidly than traditional on-site visits alone.

Recommendations
Sponsors should formally document their risk assessment methodologies and ensure these assessments directly inform the creation and revision of monitoring plans. Monitoring plans must be detailed, outlining the study design, specific data sampling strategies, and clear protocols for escalating significant issues. When significant problems are identified, sponsors must conduct a timely root cause analysis and implement corrective and preventive actions. All monitoring activities, findings, and subsequent actions should be thoroughly documented and communicated to sponsor management, clinical site staff, and other relevant parties.

Regulatory Considerations
FDA regulations mandate sponsor oversight and proper monitoring but do not prescribe specific methods, providing the flexibility for sponsors to adopt a risk-based approach. The FDA may request a sponsor's risk assessment and monitoring plan documentation during an inspection. This guidance represents the Agency's current thinking and is nonbinding, allowing sponsors to use alternative approaches if they satisfy regulatory requirements. A key focus of monitoring should be to ensure critical trial processes, such as the maintenance of blinding, are protected to maintain overall data and trial integrity.

Findings
COA-based endpoints should reflect meaningful patient health aspects and support clear treatment effect inferences.
Selection of endpoints requires a well-supported rationale, including evidence of their importance to patients.
Use of MSD and MSR approaches enhances the interpretation of treatment effects by linking COA scores to meaningful patient experiences. Proper anchors (e.g., global impression of severity) are essential for validating these approaches.
Frequency and timing of COA data collection must align with disease characteristics and study objectives.
Adjustments for potential practice effects and assistive device use are critical for robust outcome measurement.
Proper handling of missing data and sensitivity analyses ensure valid conclusions from COA-based endpoints.
Continuous, ordinal, and dichotomized endpoints require tailored statistical methods for analysis.
Early engagement with the FDA is crucial for aligning study designs and COA approaches with regulatory expectations.

Recommendations
Engage patients and caregivers early to identify meaningful endpoints and assess potential barriers to COA use.
Use anchor-based methods to validate COA scores and define meaningful thresholds for interpretation.
Develop and pilot test study protocols to ensure COA reliability, usability, and alignment with regulatory requirements.
Implement strategies to reduce participant burden, such as concise COA instruments and patient-friendly data collection methods.
Submit comprehensive documentation, including endpoint justification and scoring rationale, to FDA for feedback before trial initiation.

Regulatory Considerations
Endpoints must be supported by evidence of their fit-for-purpose status and alignment with the trial’s objectives.
COAs used in digital or adaptive formats must meet FDA’s standards for usability and data integrity.
Trials with nonrandomized designs require robust measures to mitigate bias in COA-based endpoint analysis.
Thresholds for MSD or MSR must be prespecified and justified with empirical evidence.
Sponsors must follow FDA guidance for submitting COA-based data, ensuring compliance with electronic data standards.

Findings
High rates of missing data in DHTs compared to traditional measures due to technical and software difficulties.
Practical issues such as unfamiliarity with platforms, connectivity difficulties, and lack of data visibility.
Specific technical issues like blocking of websites by firewalls and failed software updates leading to data loss.

Recommendations
Ensure appropriate workforce training for those involved in DHT deployment.
Conduct pilot evaluations in study sites to identify potential issues early.
Improve data visibility at both site and central coordinating team levels.
Implement robust feasibility testing before full-scale deployment.
Co-design DHTs with study staff and patients to enhance usability.

Regulatory Considerations
The FDA requires adequate training, education, and experience for those responsible for data capture using mobile technologies.
Ensure data integrity through oversight responsibilities as recommended by the Clinical Trials Transformation Initiative.

Key Principles (Findings)
The core principle of the Critical Path Innovation Meeting (CPIM) program is that early, non-binding communication between the FDA and innovators can accelerate the development of new Drug Development Tools (DDTs). The program is designed to be a collaborative, scientific discussion, not a formal regulatory review of a specific product. A key finding from the program's existence is that a dedicated forum to discuss emerging science—outside the context of a specific drug application—is critical for advancing regulatory science and modernizing the drug development process.

Recommendations for Stakeholders
The program implicitly recommends that innovators (from industry, academia, etc.) proactively seek the FDA's perspective on novel methodologies and technologies. Stakeholders are encouraged to request a CPIM to discuss potential biomarkers, novel clinical outcome assessments (COAs), innovative clinical trial designs, and other new tools. The goal is for sponsors to gain a better understanding of the FDA's thinking on a particular topic, which can help guide their development efforts and de-risk future regulatory submissions.

Regulatory Considerations
A CPIM is an informal, non-binding scientific discussion and does not replace formal regulatory meetings like pre-IND or End-of-Phase meetings. The advice provided by the FDA during a CPIM does not constitute a regulatory decision or a commitment for a future approval pathway. The program is part of the FDA's broader "Critical Path Initiative" and is intended to promote innovation by enhancing communication. Any outcomes or suggestions from a CPIM are for informational purposes to help guide the development of novel tools and approaches.

Findings
Meaningful outcome measures should align with patient priorities and clinical relevance, emphasizing aspects of health that impact daily life.
Digital tools must demonstrate value over traditional methods in capturing outcomes, especially in remote or decentralized contexts.
Questions about therapeutic benefit and endpoint sensitivity must address how these measures reflect patient improvements or disease progression.
Stakeholder collaboration is critical to selecting and validating concepts of interest and corresponding outcome measures.
Challenges include ensuring data privacy, operational feasibility, and addressing potential gaps in endpoint validation.

Recommendations
Engage patients and caregivers to identify meaningful aspects of health and concepts of interest relevant to their daily lives and goals.
Collaborate with clinicians to determine the clinical validity and utility of proposed measures and tools for endpoint development.
Ensure that DHTs selected for measurement add value beyond traditional methods and are feasible for clinical and real-world use.
Incorporate payer perspectives to align outcome measures with cost-benefit evaluations and reimbursement criteria.
Use the question bank as a flexible guide, adapting it to the specific needs and context of individual clinical trials.

Regulatory Considerations
Ensure endpoints and their measures meet regulatory standards for clinical relevance and sensitivity to therapeutic changes.
Align outcome measures with accepted core sets (e.g., COMET database) and validate them through stakeholder engagement.
Address concerns related to data privacy, scalability, and operational feasibility in the use of DHTs for endpoint development.
Plan for regulatory engagement to demonstrate the robustness of digitally-derived endpoints in pivotal clinical trials.
Provide evidence to support the incorporation of novel endpoints into regulatory and payer frameworks for decision-making.