Findings
While verification, analytical validation, and clinical validation have been well-established, usability validation has not been systematically incorporated into digital health technology evaluation.
Variability in device designs, patient populations, and regulatory environments creates barriers to widespread adoption of sensor-based digital health technologies.
Usability problems, such as poor user interfaces and technical errors, can lead to significant data loss in clinical trials and real-world applications.
While some guidance exists for usability in medical devices, there is no unified global standard for assessing usability in digital health products, leading to inconsistencies in implementation.
Stakeholders, including regulators, industry leaders, and researchers, recognize the need for usability validation to ensure the real-world effectiveness of digital health technologies.

Recommendations
Adopt the V3+ framework as a standardized method to ensure that usability is rigorously tested alongside verification, analytical validation, and clinical validation.
Establish clear protocols for usability testing, including use specification development, risk analysis, iterative formative evaluations, and summative evaluations.
Bring together regulators, technology developers, clinicians, and patients to create guidelines that ensure fit-for-purpose digital health solutions.
Work with regulatory agencies such as FDA, EMA, and MHRA to establish harmonized global standards for usability validation.
Encourage the publication of usability study results, including negative findings, to facilitate transparency and continuous improvement in digital health technologies.

Regulatory Considerations
Agencies like FDA and EMA increasingly require usability data for digital health technologies, but standardized methodologies are still evolving.
Usability validation should align with regulatory requirements for medical devices and digital biomarkers, ensuring clinical relevance and data integrity.
Digital health technologies must adhere to HIPAA, GDPR, and other data protection regulations while ensuring seamless usability.
Poor usability can lead to missing or unreliable data, which affects regulatory submissions and real-world evidence generation.
A consistent approach to usability evaluation is needed to support regulatory decision-making and digital health product approvals globally.

Findings
The DTRA Best Practice Evaluation Rubric uses five dimensions to determine if a DCT practice should be considered a "best practice":
Evidence of Success: Requires measurable and demonstrable success using KPIs and tangible outcomes.
Improving Patient Experience: Must address the needs of patients, caregivers, and therapeutic experts, demonstrating improved experience and engagement.
Site Impact: Must consider the implications of adoption and the practical impact on site burden and working practices.
Operational and Technical Feasibility: Ensures operational and technical aspects (including ongoing support, security, integrity, scaling, and reuse) have been fully considered when deploying new technologies.
Regulatory & Ethical Compliance: Requires appropriate consideration of global and local regulations and guidance (e.g., ICH E6/E8, GDPR, HIPAA), including adherence to privacy, consent, and ethical safeguards.

Recommendations
A practice should demonstrate several key factors across the dimensions:
Patient-Centricity: Reduce patient burden by offering the option to reduce physical visits and enable greater patient empowerment and access to information. It should strive to increase the diversity of recruited patients while mitigating bias toward technologically literate patients.
Site Support: Achieve a net reduction in burden for sites, utilizing simple, intuitive technology with minimal, on-demand training. It must provide clarity of fiduciary responsibility and use technology to increase risk-based monitoring without sacrificing data integrity.
Technical Rigor: Have a clear problem statement and a thoroughly defined strategy to mitigate operational and technical risks. It should take a holistic approach and ensure the solution is fit for use for the specific patient population, aligning with data privacy and security standards.

Regulatory Considerations
Practices must ensure compliance with both global and local regulations and Health Authority guidance. Explicit attention must be given to aligning with ICH E6 (Good Clinical Practice) and privacy laws like GDPR and HIPAA. The design must protect stakeholders providing sensitive or personal data with safeguards to ensure ethical safety.

Findings
Sufficient resources must be allocated, including infrastructure costs, training, and site reimbursement, to ensure smooth PT deployment.
PTs must be intuitive, validated, and able to withstand technical or environmental challenges to avoid burdening patients and sites.
PTs must comply with data privacy laws (e.g., GDPR, HIPAA) and regulatory standards (e.g., 21 CFR Part 11), and address import restrictions and age limitations.
Scaling PTs requires plans for device maintenance, multilingual support, and consistent availability across geographies and populations.
Sites need adequate training, realistic responsibilities, and clear workflows to avoid overburdening site staff and ensure patient compliance.

Recommendations
Involve key stakeholders (e.g., clinical technologies, regulatory affairs, site relations) early in the planning process to address potential challenges.
Identify risks related to usability, compliance, and data integrity, and establish mitigation strategies before implementation.
Provide tailored training materials for patients and site staff, ensuring clarity and accessibility in multiple formats and languages.
Develop Clear Vendor Contracts: Clearly outline responsibilities for maintenance, data management, and support in vendor contracts to avoid operational ambiguities.
Create Scalability Plans: Address challenges like multilingual support, long-term device maintenance, and cross-region deployment during the initial planning stages.

Regulatory Considerations
Ensure PTs comply with GDPR, HIPAA, and other relevant data protection regulations, particularly in global trials.
Verify if PTs qualify as medical devices and adhere to corresponding regulatory frameworks.
Assess and plan for country-specific import restrictions and data privacy laws to avoid delays.
Validate PTs according to Good Clinical Practice (GCP) guidelines, ensuring reliable data generation and compliance with regulatory standards.
Account for age-related legal restrictions, ensuring PTs are suitable for all intended patient populations.

Findings
Patient technologies were used across 55 countries, with mobile applications (53%) and wearable devices (33%) being the most common technologies.
Common data issues included data transmission failures, duplicate or missing data, and integration challenges with other datasets.
Factors like technical literacy, device usability, and preferences for paper-based alternatives affected adoption rates, particularly in elderly populations.
Varying broadband connectivity, importation hurdles, and compliance with regulations like GDPR posed significant challenges.
Most sponsors (54%) were willing to reuse technologies, citing improved retention, compliance, and remote monitoring capabilities as key benefits.

Recommendations
Consider patient demographics, such as age and technical literacy, when selecting and implementing technologies.
Offer multi-format training for sites, patients, and monitors, and provide robust support systems to address technical and compliance issues.
Risk Mitigation: Anticipate potential issues like data loss, non-compliance, and technical failures by incorporating backup processes into protocols.
Conduct feasibility assessments for site infrastructure and regulatory compliance in target regions to minimize delays.
Regularly gather experiential feedback from patients to refine technologies and improve future trial designs.

Regulatory Considerations
Seek advice from regulators to ensure patient technologies align with clinical trial protocols and data submission requirements.
Ensure Compliance with GDPR and Local Regulations: Address privacy concerns and adapt technologies to meet country-specific requirements.
Prepare Documentation for Importation: Account for additional time and costs related to import licenses and customs requirements.
Plan for the impact of technical updates on clinical data reliability and regulatory submissions.

Findings
Lack of consensus on the type and scope of digital outcome measures.
Partial integration of mobile health technologies into clinical practice.
Challenges in data presentation and interpretation.
Poorly addressed patient compliance and technology illiteracy.
Validation challenges for mobile health technologies.

Recommendations
Target deficits confirmed to be relevant to patients.
Use a combination of devices with an acceptable benefit-to-burden ratio.
Integrate data into patient management platform standards.
Ensure regulatory approval and adoption by healthcare organizations.
Consider pilot use of competing platforms for better integration.

Regulatory Considerations
Understand and overcome regulatory hurdles.
Ensure sustainable financial models.
Consider pilot use of platforms for regulatory integration.

Findings
Organizational challenges such as risk-averse corporate culture and lack of strategy hinder PT adoption.
Business-related challenges include unclear ROI and limited willingness to invest.
External challenges involve regulatory implications and technology landscape issues.
Internal disconnections within companies lead to inefficiencies in PT initiatives.

Recommendations
Improve understanding and communication between all clinical trial stakeholders.
Engage with sites and patients to inform trial design.
Address internal disconnections within companies to facilitate PT adoption.
Develop a clear business case for PT to encourage investment.
Enhance training and support for technology use in clinical trials.

Regulatory Considerations
Lack of specific guidance for PT use in clinical trials.
Geographic variability in regulations and interpretations.
Privacy and security concerns related to data management.

Findings
Successful PT implementation requires iterative planning across six stages to adapt to changing study goals and patient needs.
Early engagement with patients, caregivers, sites, and regulatory bodies is critical to align PT goals with stakeholder priorities.
Identifying technical, operational, and compliance risks early on is essential for smooth implementation and scalability.
Rapid, small-scale tests of technologies can help address unknowns, refine user experience, and mitigate technical risks before full-scale pilots.
Scaling PT across geographies and populations requires addressing regional variations in infrastructure, regulations, and cultural acceptance.

Recommendations
Start with a clear, organization-wide PT strategy to align with clinical trial goals and define success metrics.
Involve patients, sites, and regulatory authorities early to gather insights and ensure alignment with their needs and priorities.
Test technologies in controlled environments to validate functionality, usability, and integration before pilot studies.
Use technology pilots to collect data on feasibility, usability, and implementation challenges to inform broader rollouts.
Leverage learnings from pilots to develop a scalable strategy that addresses technical, regulatory, and cultural barriers.

Regulatory Considerations
Determine whether the technology is classified as a medical device and ensure compliance with relevant regulations (e.g., FDA, EMA, MDR).
Address data protection regulations, such as GDPR, by implementing robust privacy measures and secure data storage practices.
Account for region-specific regulatory requirements and infrastructure challenges during scaling.
Proactively consult regulatory agencies during pilots to align on technology use, endpoints, and data validity.