Findings
Cytokine Release Syndrome (CRS) is a common and potentially life-threatening adverse event of immunotherapies, particularly in Oncology, complicating patient care and increasing healthcare costs. Standard-of-care inpatient monitoring for CRS is manual, intermittent, costly, and restrictive, providing an incomplete view of the syndrome’s development and progression. The use of Digital Health Technologies (DHTs) for continuous, remote monitoring of vital signs (like heart rate, respiratory rate, skin temperature, SpO2, and activity) can capture early indicators of CRS up to two hours earlier than standard episodic monitoring. This ability to collect multivariate continuous data is valuable for informing robust model development for CRS risk prediction.

Recommendations
Investigators should deploy DHTs available today to monitor vital signs and symptoms currently observed in the hospital setting, but in an outpatient or home environment. The goal is to develop Early Warning Products that assess the probability of developing CRS, providing clinical decision support. Product developers should follow a strategic roadmap that outlines milestones for building products that are clinically relevant and commercially viable. Researchers should use a common set of digital clinical measures to gather high-quality datasets and ensure comparability across studies to build more robust predictive models. Predictive algorithms should be built on a robust reference measure for analytical validation and be clinically validated with sufficient data.

Regulatory Considerations
The resources are designed to help developers build products that are clinically appropriate, regulatory-acceptable, and commercially viable. Future regulatory submissions for CRS de-risking products will benefit from aligning with this industry-wide dialogue that is being built in collaboration with the FDA. Developing a robust CRS safety biomarker could enhance the safety profile of clinical trials, increase trial access, and streamline regulatory decision-making, possibly through a qualification pathway. Products that aim for a higher level of autonomy, such as a Diagnostic that redefines current CRS grading classes, may require very high clinical evidence and likely stringent regulatory review.

Findings
COA-based endpoints should reflect meaningful patient health aspects and support clear treatment effect inferences.
Selection of endpoints requires a well-supported rationale, including evidence of their importance to patients.
Use of MSD and MSR approaches enhances the interpretation of treatment effects by linking COA scores to meaningful patient experiences. Proper anchors (e.g., global impression of severity) are essential for validating these approaches.
Frequency and timing of COA data collection must align with disease characteristics and study objectives.
Adjustments for potential practice effects and assistive device use are critical for robust outcome measurement.
Proper handling of missing data and sensitivity analyses ensure valid conclusions from COA-based endpoints.
Continuous, ordinal, and dichotomized endpoints require tailored statistical methods for analysis.
Early engagement with the FDA is crucial for aligning study designs and COA approaches with regulatory expectations.

Recommendations
Engage patients and caregivers early to identify meaningful endpoints and assess potential barriers to COA use.
Use anchor-based methods to validate COA scores and define meaningful thresholds for interpretation.
Develop and pilot test study protocols to ensure COA reliability, usability, and alignment with regulatory requirements.
Implement strategies to reduce participant burden, such as concise COA instruments and patient-friendly data collection methods.
Submit comprehensive documentation, including endpoint justification and scoring rationale, to FDA for feedback before trial initiation.

Regulatory Considerations
Endpoints must be supported by evidence of their fit-for-purpose status and alignment with the trial’s objectives.
COAs used in digital or adaptive formats must meet FDA’s standards for usability and data integrity.
Trials with nonrandomized designs require robust measures to mitigate bias in COA-based endpoint analysis.
Thresholds for MSD or MSR must be prespecified and justified with empirical evidence.
Sponsors must follow FDA guidance for submitting COA-based data, ensuring compliance with electronic data standards.

Findings
The development of this standardized questionnaire highlights a critical gap in clinical research: the lack of a consistent method for collecting participant feedback. It implicitly finds that understanding the patient experience is essential for addressing issues like high dropout rates and patient burden. The tool's detailed sections suggest that factors from communication and scheduling to technology usability and visit burden are key determinants of a participant's trial experience.

Recommendations
The resource strongly recommends that sponsors and research sites proactively gather structured feedback directly from study participants. It advises using this tool to identify specific pain points in trial design and execution. The underlying recommendation is to adopt a more patient-centric and human-centered approach by integrating participant feedback into the continuous improvement of clinical trial protocols and operations, ultimately boosting recruitment and retention.

Regulatory Considerations
While not a formal regulatory guidance document, the tool supports the principles of patient-focused drug development (PFDD) encouraged by regulatory bodies like the FDA. Collecting data on the patient experience can help demonstrate that a trial's design and conduct minimizes undue burden and is ethically sound. This feedback can be a valuable component of submissions, illustrating a commitment to patient centricity and potentially improving the assessment of a trial's overall quality and integrity

Findings
High rates of missing data in DHTs compared to traditional measures due to technical and software difficulties.
Practical issues such as unfamiliarity with platforms, connectivity difficulties, and lack of data visibility.
Specific technical issues like blocking of websites by firewalls and failed software updates leading to data loss.

Recommendations
Ensure appropriate workforce training for those involved in DHT deployment.
Conduct pilot evaluations in study sites to identify potential issues early.
Improve data visibility at both site and central coordinating team levels.
Implement robust feasibility testing before full-scale deployment.
Co-design DHTs with study staff and patients to enhance usability.

Regulatory Considerations
The FDA requires adequate training, education, and experience for those responsible for data capture using mobile technologies.
Ensure data integrity through oversight responsibilities as recommended by the Clinical Trials Transformation Initiative.

Findings
There is a notable lack of reports on the use of digital health technology in pediatric patients.
Challenges exist in selecting the design, metrics, and types of sensors best suited for disease evaluation.
False positive detection remains problematic in seizure detection using DHTs.
There is a lack of information on the use of DHTs in infants.
Unique design challenges for pediatric DHTs arise from size, anatomy, physiology, activity levels, and cognitive development.

Recommendations
Further research and evaluation are needed to realize the full potential of remote monitoring in pediatric trials.
Creative approaches, including machine learning, should be employed to identify optimal measurement methods.
Training for caregivers is necessary to ensure DHTs are worn correctly and data are complete.

Regulatory Considerations
Confirming the reliability and clinical relevance of DHT measurements is essential.
Ensuring privacy and confidentiality of patient data must be prioritized.

Findings
Traditional RCTs face high costs, long timelines, recruitment challenges, and lack of diversity.
Recruitment efficiency in stroke trials has decreased over the past 25 years.
Digital tools for stroke prevention often lack quality and interactive functionality.
Decentralized RCTs present challenges in data quality and require validation.
Regulatory and compliance requirements vary significantly across regions.

Recommendations
Adopt decentralized RCTs with a patient-centric approach.
Leverage digital technologies to improve trial efficiency and participant experience.
Ensure participant engagement and education in trial design.
Provide high-quality training and support for decentralized procedures.

Regulatory Considerations
Collaborate with regulatory agencies early in trial design.
Compliance with varying international standards is necessary.
Rapid evolution of technology outpaces regulatory changes.
Cross-border data standards and privacy rules must be observed.

Findings
Clinical trial protocols designed without patient input often result in a high participant burden and a poor patient experience, leading to challenges in trial enrollment, adherence, and retention.
A lack of early patient engagement can lead to study designs that are not feasible, collect data on outcomes that aren't meaningful to patients, and require costly protocol amendments later in the process.
Many sponsors and research teams lack a structured, systematic process and standardized tools for effectively planning and executing patient engagement activities.
Meaningful patient partnerships can lead to research of greater quality and relevance, as patients provide unique insights into living with their condition and the practicality of trial procedures.

Recommendations
Adopt a structured toolkit and systematic process to plan patient engagement, define objectives, select appropriate methods, and apply learnings to the protocol.
Engage with patients and caregivers as early as possible in the protocol development lifecycle to ensure their insights can meaningfully influence the study design.
Carefully select diverse patient partners based on criteria like their disease experience, and choose appropriate engagement methods (e.g., advisory boards, focus groups, surveys) to meet defined goals.
Use provided guides, templates, and visual aids to facilitate clear communication, manage expectations, and effectively gather, assess, and implement patient feedback.

Regulatory Considerations
Patient engagement in trial design is strongly encouraged by global regulatory bodies, including the U.S. Food and Drug Administration (FDA).
These activities align with regulatory initiatives like the FDA's Patient-Focused Drug Development (PFDD) guidance, which emphasizes collecting data that reflects patient experiences, needs, and priorities.
Incorporating patient feedback helps ensure that a clinical trial is designed to capture meaningful endpoints and outcomes, which supports subsequent regulatory and Health Technology Assessment (HTA) review.

Findings
Qualitative Methods: One-on-one interviews provide in-depth individual insights, while focus groups capture diverse perspectives through participant interaction.
Approaches such as Delphi panels and observational methods can complement interviews and focus groups in understanding patient experiences.
Quantitative Methods: Surveys provide structured, quantifiable data and are effective for large populations.
Careful design of questions and response options minimizes bias and improves data quality.
Mixed Methods:Combining qualitative and quantitative techniques enhances understanding and validates findings.
Sequential and concurrent designs can address complex research questions and improve robustness.
Barriers to Self-Report: Special adaptations may be needed for patients with disabilities, pediatric populations, or those with language or cultural differences.
Proxy reporting by caregivers is sometimes necessary but may introduce bias.
Social Media: Useful for real-time or retrospective insights into patient perspectives. Limitations include lack of verified identities and potential bias in user demographics.

Recommendations
Choose data collection methods aligned with research objectives and the target population.
Use open-ended questions for qualitative research to elicit unbiased responses; avoid leading or judgmental prompts.
Pilot test interview guides, surveys, and response options to ensure clarity and relevance.
Integrate cultural and linguistic adaptations for diverse populations in multinational studies.
For mixed-method research, establish clear objectives for combining qualitative and quantitative components and address conflicting findings systematically.

Regulatory Considerations
Data collected through qualitative or quantitative methods must meet regulatory standards for integrity and reliability when submitted to the FDA.
Screening and exit interviews should not interfere with the integrity of ongoing clinical trials; use trained third-party interviewers where appropriate.
Researchers should follow ethical standards and federal regulations when using social media data, ensuring informed consent and data privacy.

Findings
Patient-Reported Outcome (PRO) instruments are a type of Clinical Outcome Assessment that provides valid scientific evidence for regulatory and healthcare decision-making regarding medical devices. The FDA encourages the integration of patient perspectives throughout the Total Product Lifecycle (TPLC). PRO instruments can be used to measure the effects of a medical intervention, including the impact on patient well-being and Health-Related Quality of Life (HRQOL). The validity evidence needed to support a PRO instrument's use is determined by its specific Context of Use (COU) and role (e.g., primary, secondary endpoint) in the clinical study protocol. To be "fit-for-purpose," a PRO instrument must measure a Concept of Interest (COI) that is meaningful to patients and whose measurement is supported by evidence that is consistent with the intended use population.

Recommendations
Sponsors should establish and clearly define the Concept of Interest (COI) the PRO instrument is intended to capture. It is recommended that sponsors clearly identify the role of the PRO (e.g., primary, secondary, effectiveness, safety) in the clinical study protocol and statistical analysis plan. The development or modification of PRO instruments should measure concepts important to patients to reduce unnecessary patient burden and ensure the outcomes are relevant to a patient's daily lived experience. Cognitive interviews should be conducted to ensure the instrument's instructions and items are understandable to the intended use population, including patients with limited English language proficiency. Sponsors are encouraged to leverage existing PRO instruments (by using them as-is, modifying, or adapting) as a least burdensome approach to take advantage of existing validity evidence. Alternative approaches, such as using Real-World Data (RWD) platforms or conducting parallel development work during clinical studies, are encouraged to efficiently generate validity evidence.

Regulatory Considerations
The FDA encourages sponsors to engage with the Agency regarding the relevance and suitability of a proposed PRO instrument early in the development process, prior to the Investigational Device Exemption (IDE) submission or pivotal study. The Q-Submission program is the recommended pathway for sponsors to obtain feedback from the FDA regarding cognitive interview approaches and the modification or adaptation of existing instruments. The Agency uses the fit-for-purpose concept as a flexible approach to determine the validity evidence needed for a PRO instrument's specified use for a regulatory purpose. The use of PRO instruments that have been qualified under the Medical Device Development Tools (MDDT) program is encouraged. Sponsors should prospectively specify the intent to generate validity evidence in the clinical study protocol and statistical analysis plan, even if the evidence will only support future studies.

Findings
Advantages of MCTs: Investigators highlighted remote data capture, access to real-time data for monitoring, and improved data quality as major benefits. They also noted reduced participant burden due to fewer in-person visits and increased participant engagement through real-time data access.
Challenges of MCTs: Increased site burden due to additional time required for technology setup, troubleshooting, and managing high data volumes was a common theme. Participants faced challenges such as technology unfamiliarity, device management, and potential behavior changes from real-time data access.
Support Needs: Investigators emphasized the need for technical support, staff training, and increased budgetary resources to manage devices and train participants. They also highlighted the importance of clear communication about device selection and capabilities from sponsors.

Recommendations
Sponsors should supply comprehensive device training, including hands-on and supplemental materials, and establish systems for ongoing technical support throughout the trial.
Include funds for device management, staff training, and participant support to accommodate the additional demands of MCTs.
Prioritize user-friendly devices to minimize participant burden and improve adherence.
Collaborate with investigators and participants during trial planning to ensure technologies align with study objectives and participant needs.
Focus on in-person, hands-on training to ensure staff and participants are comfortable with the technologies.

Regulatory Considerations
Devices must meet data security and safety requirements to address Institutional Review Board (IRB) concerns.
Provide detailed information about device safety, storage, and capabilities to ensure compliance with regulatory standards.
Clearly communicate data access levels to participants, minimizing risks of data misinterpretation.

Findings
Advantages of MCTs: Investigators highlighted streamlined study operations, remote data capture, and higher-quality, real-time data collection as key benefits. MCTs were also noted for their potential to reduce participant burden by enabling remote participation.
Challenges of MCTs: Investigators reported increased operational challenges, such as device setup, maintenance, and troubleshooting. They also noted time burdens for staff and uncertainties regarding data quality, including potential biases and technical malfunctions.
Support Needs: Investigators emphasized the need for technical support, comprehensive training for staff and participants, and adequate budgetary planning to address additional costs associated with MCTs.
Participant Considerations: While MCTs offer convenience and engagement opportunities for participants, challenges include the intrusiveness of data capture, technology adoption barriers, and potential negative impacts of real-time data access on participant behavior.
Recommendations: Investigators stressed the importance of collaborative relationships between sponsors and sites, user-friendly technology selection, and participant-centric trial designs.

Recommendations
Improve Training and Support: Sponsors should provide hands-on training for staff and participants, including troubleshooting support and device-specific materials.
Plan Budgets Appropriately: Include funds for device procurement, staff time, and technology management in trial budgets.
Enhance Technical Support: Sponsors should establish centralized technical support systems to address technology-related issues during trials.
Select Participant-Friendly Technologies: Prioritize devices that are intuitive, minimally intrusive, and suitable for the target population's needs.
Engage Stakeholders Early: Collaborate with investigators, participants, and sponsors during trial planning to align expectations and address potential challenges.

Regulatory Considerations
Data Security: Ensure data collected by mobile technologies comply with privacy and security regulations, and communicate these measures to IRBs.
Device Validation: Validate devices for the intended trial context to ensure reliability and minimize technical risks.
Participant Communication: Clearly inform participants about how their data will be used and provide transparency regarding data access.

Findings
Sponsors must weigh the study benefits of PTs against potential burdens such as usability challenges, frequent reminders, or the need for connectivity and device maintenance.
Factors such as geography, socioeconomics, cultural practices, and technical literacy must be addressed to ensure PT accessibility across diverse patient populations.
Sponsors need to protect patient privacy by adhering to data protection standards and ensuring informed consent materials clearly communicate how data will be used and stored.
Effective maintenance, training, and 24/7 support systems for patients and sites are critical to ensure smooth operation and minimize disruptions.
Providing value to participants, such as progress feedback or gamification elements, can improve the patient experience and adherence.

Recommendations
Design Patient-Centric Materials: Simplify patient-facing materials, tailoring them to low health and technical literacy levels, and ensure patient input is incorporated during the design phase.
Identify and address geographic, socioeconomic, and cultural barriers to technology adoption to ensure inclusivity.
Offer multi-format training for patients and caregivers, provide troubleshooting guides, and ensure 24/7 multilingual technical support.
Safeguard patient data and inform patients of all potential risks associated with PTs. Develop backup plans for device failures or power outages.
Assess how PTs affect daily living, including comfort, usability, and the time required for setup and routine use, to minimize intrusion.

Regulatory Considerations
Ensure adherence to GDPR, HIPAA, and other relevant data protection laws. Clearly communicate privacy and data use details in consent forms.
Validate PTs for safety and suitability in the target population and ensure compliance with regulatory standards for medical devices.
Ensure that consent forms clearly describe PT functionality, benefits, and limitations in accessible language.
Global Adaptability: Account for regional laws, infrastructure limitations, and language requirements to ensure PT compatibility and regulatory compliance across geographies.