Industry spotlight
BEST PRACTICES FROM DIME
DiMe’s Sensor Data Integration Quick Start Guides provide practical checklists on data collection, data transmission, data processing, data privacy, data security, and data quality.
INDUSTRY RESOURCE
CDISC and the Digital Medicine Society (DiMe) have partnered to enhance interoperability and comparability of data across different DHTs and accelerate innovation in digital health through shared standards and common semantics. To this end, CDISC is leading a volunteer team of diverse stakeholders to address opportunities for data standardization focused in the following areas:
- Key DHT Concepts in clinical research
- Device Attributes that contextualize collected data
- Digital Endpoints collected using DHTs
- Best Practices for using CDISC standards and DiMe resources with DHTs in clinical research.
BEST PRACTICES BY CTTI
Discusses processes for the implementation, operation, and maintenance of digital health technologies in the field prior to launching the trial, including data considerations.
PUBLICATION
Mobile technologies offer the potential to reduce the costs of conducting clinical trials by collecting high-quality information on health outcomes in real-world settings that are relevant to patients and clinicians. However, widespread use of mobile technologies in clinical trials has been impeded by their perceived challenges. To advance solutions to these challenges, the Clinical Trials Transformation Initiative (CTTI) has issued best practices and realistic approaches that clinical trial sponsors can now use. These include CTTI recommendations on technology selection; data collection, analysis, and interpretation; data management; protocol design and execution; and US Food and Drug Administration submission and inspection. The scientific principles underpinning the clinical trials enterprise continue to apply to studies using mobile technologies. These recommendations provide a framework for including mobile technologies in clinical trials that can lead to more efficient assessment of new therapies for patients. (Abstract)
PUBLICATION
Digital health technologies (DHTs) have great potential for use as clinical trial outcomes; however, practical issues need to be addressed in order to maximise their benefit. We describe our experience of incorporating two DHTs as secondary/exploratory outcome measures in PD STAT, a randomised clinical trial of simvastatin in people with Parkinson’s disease. We found much higher rates of missing data in the DHTs than the traditional outcome measures, in particular due to technical and software difficulties. We discuss methods to address these obstacles in terms of protocol design, workforce training and data management. (Abstract)
PUBLICATION
Includes discussion on data processing, standards, security, and ethics.
“Health care has had to adapt rapidly to COVID-19, and this in turn has highlighted a pressing need for tools to facilitate remote visits and monitoring. Digital health technology, including body-worn devices, offers a solution using digital outcomes to measure and monitor disease status and provide outcomes meaningful to both patients and health care professionals. Remote monitoring of physical mobility is a prime example, because mobility is among the most advanced modalities that can be assessed digitally and remotely. Loss of mobility is also an important feature of many health conditions, providing a read-out of health as well as a target for intervention. Real-world, continuous digital measures of mobility (digital mobility outcomes or DMOs) provide an opportunity for novel insights into health care conditions complementing existing mobility measures. Accepted and approved DMOs are not yet widely available. The need for large collaborative efforts to tackle the critical steps to adoption is widely recognised. Mobilise-D is an example. It is a multidisciplinary consortium of 34 institutions from academia and industry funded through the European Innovative Medicines Initiative 2 Joint Undertaking. Members of Mobilise-D are collaborating to address the critical steps for DMOs to be adopted in clinical trials and ultimately health care. To achieve this, the consortium has developed a roadmap to inform the development, validation and approval of DMOs in Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease and recovery from proximal femoral fracture. Here we aim to describe the proposed approach and provide a high-level view of the ongoing and planned work of the Mobilise-D consortium. Ultimately, Mobilise-D aims to stimulate widespread adoption of DMOs through the provision of device agnostic software, standards and robust validation in order to bring digital outcomes from concept to use in clinical trials and health care.” (Abstract)
PUBLICATION
Digital health technologies (smartphones, smartwatches, and other body-worn sensors) can act as novel tools to aid in the diagnosis and remote objective monitoring of an individual’s disease symptoms, both in clinical care and in research. Nonetheless, such digital health technologies have yet to widely demonstrate value in clinical research due to insufficient data interpretability and lack of regulatory acceptance. Metadata, i.e., data that accompany and describe the primary data, can be utilized to better understand the context of the sensor data and can assist in data management, data sharing, and subsequent data analysis. The need for data and metadata standards for digital health technologies has been raised in academic and industry research communities and has also been noted by regulatory authorities. Therefore, to address this unmet need, we here propose a metadata set that reflects regulatory guidelines and that can serve as a conceptual map to (1) inform researchers on the metadata they should collect in digital health studies, aiming to increase the interpretability and exchangeability of their data, and (2) direct standard development organizations on how to extend their existing standards to incorporate digital health technologies. The proposed metadata set is informed by existing standards pertaining to clinical trials and medical devices, in addition to existing schemas that have supported digital health technology studies. We illustrate this specifically in the context of Parkinson’s disease, as a model for a wide range of other chronic conditions for which remote monitoring would be useful in both care and science. We invite the scientific and clinical research communities to apply the proposed metadata set to ongoing and planned research. Where the proposed metadata fall short, we ask users to contribute to its ongoing revision so that an adequate degree of consensus can be maintained in a rapidly evolving technology landscape. (Abstract)
PUBLICATION
This manuscript is focused on the use of connected sensor technologies, including wearables and other biosensors, for a wide range of health services, such as collecting digital endpoints in clinical trials and remotely monitoring patients in clinical care. The adoption of these technologies poses five risks that currently exceed our abilities to evaluate and secure these products: (1) validation, (2) security practices, (3) data rights and governance, (4) utility and usability; and (5) economic feasibility. In this manuscript we conduct a landscape analysis of emerging evaluation frameworks developed to better manage these risks, broadly in digital health. We then propose a framework specifically for connected sensor technologies. We provide a pragmatic guide for how to put this evaluation framework into practice, taking lessons from concepts in drug and nutrition labels to craft a connected sensor technology label. (Abstract)
PUBLICATION
Includes discussion on data protection and privacy.
“Regulatory acceptance of Digital Health Technology (DHT) -derived endpoints can be a long, multifaceted and costly process. Success relies on establishing a global strategy as part of the development program including health authority consultations to ensure alignment with regulatory requirements. In this manuscript, the authors provide stepwise guidance for successful implementation of DHT-derived endpoints in clinical trials for drug development.” (Abstract)
PUBLICATION
The development of innovative wearable technologies has raised great interest in new means of data collection in healthcare and biopharmaceutical research and development. Multiple applications for wearables have been identified in a number of therapeutic areas; however, researchers face many challenges in the clinic, including scientific methodology as well as regulatory, legal, and operational hurdles. To facilitate further evaluation and adoption of these technologies, we highlight methodological and logistical considerations for implementation in clinical trials, including key elements of analytical and clinical validation in the specific context of use (COU). Additionally, we provide an assessment of the maturity of the field and successful examples of recent clinical experiments. (Abstract)
Sensor Data Integrations
Sensor-generated health data must be collected in a way that ensures completeness, contextual metadata, and fit-for-purpose accuracy to support clinical applications.
Data security and privacy regulations vary globally, necessitating the implementation of adaptable frameworks such as the FAIR data principles and cybersecurity best practices.
Standardized data transmission and processing protocols are required to ensure interoperability across digital health platforms and prevent data loss or corruption.
Validation frameworks, such as DiMe’s V3 (Verification, Analytical Validation, and Clinical Validation), are essential to confirm the reliability of digital clinical measures.
Equity and accessibility considerations must be prioritized, ensuring that digital health solutions work across diverse populations and healthcare settings.
Recommendations
Digital health developers should follow standardized methodologies for data collection, leveraging frameworks such as the EVIDENCE checklist and DiMe’s V3 validation process.
Privacy-by-design principles should be embedded into sensor-based data systems to comply with HIPAA, GDPR, and emerging digital health privacy regulations.
Data processing workflows must be transparent, well-documented, and validated to ensure consistent, unbiased, and reproducible results in clinical applications.
Organizations should adopt cybersecurity best practices, including end-to-end encryption, authentication protocols, and risk mitigation strategies, to protect sensor data.
Sensor data integration strategies should be aligned with industry standards and open-source protocols to promote interoperability and scalability in healthcare ecosystems.
Regulatory Considerations
Regulatory agencies such as the FDA encourage the use of validated digital biomarkers and structured sensor data processing methodologies to support regulatory submissions.
Sensor data privacy policies must comply with local and international regulations, requiring clear user agreements, informed consent, and transparent data governance.
Secure data transmission protocols must be implemented to prevent unauthorized access, aligning with industry standards for encryption, authentication, and network security.
Organizations deploying sensor-based health technologies should conduct risk assessments and audits to ensure compliance with evolving regulatory requirements for AI and digital health.
Global harmonization of data security and transmission standards is necessary to support cross-border data exchange, facilitating regulatory approval and market access for digital health innovations.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Digital Health Technologies Initiative
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Recommendations for Selecting and Testing a Digital Health Technology
The selection of DHTs must align with the specific goals of the trial, focusing on unmet patient or scientific needs.
A specification-driven approach, rather than solely relying on a technology’s regulatory status, ensures alignment with trial requirements.
Verification and validation are distinct processes; both are critical to confirm the reliability and clinical relevance of DHTs.
Pre-trial feasibility studies help identify potential issues, such as wear-time compliance or usability concerns, before full implementation.
DHTs can alter participant interactions and trial workflows, necessitating clear communication, training, and management plans.
Recommendations
Define Measurement Goals Before Selection: Ensure that the decision to use a DHT is based on unmet needs or the promise of reducing trial burdens.
Adopt a Specification-Driven Selection Process: Tailor DHT selection to technical performance, participant needs, and study-specific requirements.
Verify and Validate Technologies Thoroughly: Collaborate with manufacturers to ensure DHTs are tested in both controlled and real-world settings and validated for the target population.
Conduct Feasibility Studies: Test DHTs for tolerability, usability, and compliance within the specific trial context to identify and address issues early.
Prepare for Operational Challenges: Develop a robust management plan with standard operating procedures (SOPs) to address potential failures and ensure smooth implementation.
Regulatory Considerations
The regulatory status of a DHT should not solely drive its selection; instead, focus on its ability to meet trial specifications.
Ensure transparent collaboration with manufacturers to document DHT performance characteristics and limitations.
Validate endpoints and DHT data to align with evidentiary standards for regulatory submissions.
Use feasibility studies and SOPs to ensure that DHTs comply with regulatory and operational requirements during trials.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Advancing the Use of Mobile Technologies in Clinical Trials: Recommendations from the Clinical Trials Transformation Initiative
Widespread use of mobile technologies in clinical trials is impeded by perceived challenges.
Scientific and technical challenges affect decision-making around using mobile technology for data capture.
Concerns include choosing appropriate technology, data collection and analysis, ensuring data authenticity, and designing protocols.
Recommendations
Use CTTI’s framework for mobile technology selection to assist sponsors.
Conduct feasibility studies prior to launching trials.
Engage with regulatory authorities early to discuss endpoint appropriateness and validation processes.
Secure data generated by mobile technologies using recommended practical approaches.
Optimize data quality to minimize variability and ensure robust conclusions.
Regulatory Considerations
Engage with the FDA early in the trial design process.
Ensure data integrity and security throughout the data life cycle.
Maintain open dialogue with regulatory authorities regarding trial-specific strategies for data collection and sharing.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Challenges of Incorporating Digital Health Technology Outcomes in a Clinical Trial: Experiences from PD STAT
High rates of missing data in DHTs compared to traditional measures due to technical and software difficulties.
Practical issues such as unfamiliarity with platforms, connectivity difficulties, and lack of data visibility.
Specific technical issues like blocking of websites by firewalls and failed software updates leading to data loss.
Recommendations
Ensure appropriate workforce training for those involved in DHT deployment.
Conduct pilot evaluations in study sites to identify potential issues early.
Improve data visibility at both site and central coordinating team levels.
Implement robust feasibility testing before full-scale deployment.
Co-design DHTs with study staff and patients to enhance usability.
Regulatory Considerations
The FDA requires adequate training, education, and experience for those responsible for data capture using mobile technologies.
Ensure data integrity through oversight responsibilities as recommended by the Clinical Trials Transformation Initiative.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
A Roadmap to Inform Development, Validation and Approval of Digital Mobility Outcomes: The Mobilise-D Approach
Lack of widely accepted tools for digital mobility assessment.
Challenges in technical and clinical validation due to multiple expertise requirements.
Inconsistent testing procedures and variations in norms.
Limitations of current mobility measurement methods.
Need for real-world mobility assessment.
Recommendations
Adopt best practices and innovate with standards and open access tools.
Ensure transparency through regular interaction with stakeholders.
Develop algorithms in an agnostic and fully documented manner.
Make data accessible through a digital data biobank.
Aim for regulatory approval with accurate real-world mobility measurement.
Regulatory Considerations:
Engage in early dialogue with regulatory authorities.
Understand different regulatory requirements based on context of use.
Focus on qualification of new methodologies for safety and efficacy.
Use DMOs to monitor disease progression and as surrogates for secondary endpoints.
Adopt a staged approach to regulatory qualification.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Metadata Concepts for Advancing the Use of Digital Health Technologies in Clinical Research
Lack of regulatory guidance on validating precision and reliability of DHT data.
Challenges in managing large, complex datasets without appropriate processing.
Insufficient integration of DHTs into existing clinical trial standards.
Recommendations
Develop a metadata set to improve data interpretability and exchangeability.
Encourage standard development organizations to extend existing standards for DHTs.
Ensure that none of the proposed metadata is compulsory, allowing flexibility based on application and resources.
Regulatory Considerations
Meet additional regulatory standards for medical devices.
Utilize guides like the FDA’s Clinical Trials Transformation Initiative for data capture.
Align metadata standards with regulatory requirements to facilitate approval.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Modernizing and designing evaluation frameworks for connected sensor technologies in medicine
There are significant risks associated with connected sensor technologies that exceed current evaluation capabilities, including validation, security practices, data rights and governance, utility and usability, and economic feasibility.
Existing evaluation frameworks are inadequate for the unique challenges posed by digital health technologies.
The regulatory environment for digital specimens is not well-established, leading to ambiguity in oversight.
Recommendations
Develop a systematic and standardized evaluation framework for connected sensor technologies.
Implement a connected sensor technology label to improve transparency and decision-making.
Encourage innovation and modern regulatory oversight through updated guidelines.
Address the evolving distinction between regulated and unregulated digital health technologies.
Enhance communication infrastructure to make information more accessible to stakeholders.
Regulatory Considerations
The regulatory environment for digital health technologies is evolving, with a need for modern oversight.
There is ambiguity in the regulation of digital specimens, requiring clearer guidelines.
The FDA has issued guidances to encourage innovation and efficient oversight.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Regulatory considerations for successful implementation of digital endpoints in clinical trials for drug development
Regulatory Acceptance is Complex: Gaining regulatory acceptance for endpoints derived from Digital Health Technologies (DHTs) is a lengthy, multifaceted, and costly process that requires a global strategy and early health authority consultation.
“Fit-for-Purpose” is Key: A DHT’s clearance or approval as a medical device does not automatically ensure it is fit-for-purpose in a clinical trial; its intended use must align with the specific context of use (COU) in the study.
Meaningfulness is a Hurdle: Demonstrating the clinical meaningfulness of novel digital endpoints, especially for abstract concepts like cognitive decline in Alzheimer’s Disease, remains a significant challenge for regulatory acceptance.
International Harmonization is Lacking: Differences in regulatory requirements for DHT validation between major health authorities can delay or prevent the successful implementation of digital measures in global clinical trials.
Technology Changes Pose Risks: Software and hardware updates to DHTs during a clinical trial can have significant implications, potentially invalidating study results if not managed through a predetermined change-control plan.
Recommendations
Engage Health Authorities Early and Often: Sponsors should conduct multiple consultations with major health authorities (e.g., FDA, EMA) early in the development process to align on the Concept of Interest (COI), COU, and the validation roadmap.
Develop a Comprehensive Regulatory Strategy: A global regulatory strategy should be an integral part of the overall development plan, tailored to the program’s objectives and endpoint hierarchy.
Establish “Fit-for-Purpose” Criteria: Before selecting a DHT, sponsors should establish the minimum technical and performance specifications required for the specific COU to guide the selection of a fit-for-purpose device.
Create a Conceptual Framework: For novel endpoints, sponsors should develop a conceptual framework that visualizes how the DHT-derived measure relates to meaningful health concepts and patient experiences.
Plan for Change and Missing Data: Sponsors should establish predetermined change-control plans with manufacturers to manage DHT updates and create risk management plans to minimize and handle missing data from remote acquisition.
Regulatory Considerations
Distinct Pathways in US vs. EU: The US FDA uses a risk-based approach for DHTs that are medical devices, while in Europe, CE marking for the intended COU is generally expected by the EMA.
Qualification is an Option, Not a Requirement: Both the FDA and EMA offer voluntary qualification programs for Drug Development Tools (DDTs), which can validate a DHT for a specific COU across multiple drug programs, though the process is resource-intensive.
Scientific Advice for Individual Programs: For DHTs used within a single drug development program, engaging with health authorities through scientific advice meetings is a more targeted and confidential pathway for gaining feedback and agreement.
Data Privacy and Security are Paramount: Sponsors must ensure that the collection, transfer, and storage of personal data via DHTs comply with all applicable regulations, such as GDPR in the EU, including cybersecurity and data transfer measures.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
Wearable Devices in Clinical Trials: Hype and Hypothesis
Researchers face challenges in scientific methodology, regulatory, legal, and operational aspects.
Many consumer-grade devices lack scientific evidence for their health claims.
There are significant challenges in data management, infrastructure, analysis, and security.
Lack of mobile technology data standards and transparency in data processing algorithms.
The need for a shared understanding of methodologies and terminology.
Recommendations
Develop industry-wide standards for data and terminology.
Foster dialogue between biopharmaceutical industry and device manufacturers for methodological development.
Ensure a patient-centric approach in clinical trials using wearable devices.
Conduct well-powered studies with clear medical problem statements.
Implement rigorous analytical and clinical validation processes.
Regulatory Considerations
Separate marketing approval paths for drugs and devices in the US.
Most wearable devices are classified as Class II devices requiring 510(k) clearance.
Compliance with HIPAA for data obtained via medical devices.
Need for device performance validation in specific populations relevant to device label claims.
Differences in US and EU regulations regarding data protection and consent requirements.
Some summaries are generated with the help of a large language model; always view the linked primary source of a resource you are interested in.
For reference: review the relevant regulatory guidances
Regulatory spotlight
Features essential guidance, publications, and communications from regulatory bodies relevant to this section. Use these resources to inform your regulatory strategy and ensure compliance.