• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

  • Opinion
  • Health IT
    • Behavioral Health
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Patient Engagement
    • Population Health Management
    • Revenue Cycle Management
    • Social Determinants of Health
  • Digital Health
    • AI
    • Blockchain
    • Precision Medicine
    • Telehealth
    • Wearables
  • Startups
  • M&A
  • Value-based Care
    • Accountable Care (ACOs)
    • Medicare Advantage
  • Life Sciences
  • Research

Where’s the Evidence? Barriers to Analyzing Digital Health’s Impact

by Meridith Peratikos, Director of Enterprise Research, axialHealthcare 04/08/2019 Leave a Comment

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print

Where’s the Evidence? Barriers to Analyzing Digital Health’s Impact

The digital health industry continues to grow at an unprecedented rate. In 2018, venture funding for digital health companies approached a record $8.1B in funding, according to Rock Health. These companies are striving to address important healthcare issues by developing products and service offerings in various categories like genome sequencing, analytics, telemedicine, mobile apps, and population health management tools—all with the promise of increased insights and patient engagement, and better care coordination that improves outcomes, costs, and access to care. These goals are crucial to moving the U.S. healthcare system toward value-based reimbursement.

That said, little evidence is available in the digital space when it comes to peer-reviewed publications, measurement of potential impact, and effect on patients with the greatest burden of disease.

Analyzing the Evidence Behind Digital Health

Health Affairs recently published a study by Kyan Safavi, Simon C. Mathews, David W. Bates, E. Ray Dorsey, and Adam B. Cohen that explored this observation. After identifying 20 of the top-funded, private US-based digital health companies, they analyzed their products and services related to peer-reviewed evidence, the potential impact on patients with high-burden conditions, and impact on the cost of or access to care.

The study found that of the few studies on digital health services published in peer-reviewed literature, most evaluated their products in healthy patients rather than high-burden patients, and clinical effectiveness studies with a high level of evidence were uncommon. Moreover, no studies evaluated the effectiveness of their products or services in terms of reducing costs or improving access to care.

These findings may lead to the assumption that digital health products and services from leading companies have had a limited impact on disease burden and cost in the healthcare system, but there’s another side to that narrative. There are myriad reasons that little evidence exists on digital health’s impact, and we discuss the most significant barriers below.

– High cost. No matter the size of the study or whether it’s conducted in-house or by a clinical research organization, peer-reviewed studies are expensive. Several factors have to be taken into consideration: length of study, the number of patients in the study, type of materials provided to patients, study staffing, training for human subject research, ethical clearance from an Institutional Review Board, and many more. These costs can be a major barrier for startups with strained budgets and tight timelines.

– Research bias and ownership. Research bias is defined as “an inclination of temperament or outlook, especially a personal and sometimes unreasoned judgment: prejudice.” Bias can occur in many stages of research, including planning, funding, data collection, analysis, and even publication. With publication bias, companies may only choose to publish self-sponsored studies that show positive results, which is one of the reasons the medical community has become adamant on studies being run and funded by an objective third party.

But for the company that developed the product or service, that means spending substantial money to contract with a third party, again something many startups don’t inherently have on tap, for a study they do not own and could negatively impact their business.

– Timeliness. Depending on the study endpoint, some trials take years from inception, planning, accrual, follow-up, completion, and analysis. Even the peer-review process is slow, and that does not even start until the study is completed. On average, it takes 13 weeks for review. Moreover, if a publication is rejected twice and accepted at the third choice journal, then a whole year may pass from completion of the paper to publication of results.

A timeline of “years” can pose a major problem for companies that are constantly innovating. Products can evolve drastically over a short period of time, but a company undergoing a randomized study would have to put product adjustments on hold. Continually assessing new scientific evidence in the pain and opioid space and if the findings indicate that we should make an adjustment to our clinical insight or analytical models, we implement the needed changes. This type of product adjustment may have to be put on hold during a study.

– Competitive advantage. Yes, there are major benefits from a peer-reviewed study highlighting a company’s products and services, but there is also a competitor concern. It is difficult to get published in high-impact journals without sharing company details that include intellectual property. That’s a major concern, especially for startups.

What can a digital health company do to prove value?

A more pragmatic approach to evaluating digital health products may be to conduct observational data analysis on routinely collected data—an approach that requires data collection, study design, and statistical analysis skills. While not as rigorous as randomized controlled studies, a moderate level of evidence is better than none at all. Additionally, the academic medical community agrees that observational data analysis is important for informing research findings and have developed guidelines called STrengthening the Reporting of OBservational studies in Epidemiology (STROBE). If followed, STROBE allows for transparency and reproducibility of the observational data analysis.

Given the long wait times for publication, digital health companies should consider the release of impact results as a white paper rather than in a peer-reviewed journal. White papers allow for quicker production of scientific knowledge and enable digital health companies to publicize results sooner. While white paper results are still met with much skepticism and would not have even been evaluated by Safavi et al,  if the culture around releasing results could emphasize transparency and reproducibility, then perhaps peer-review becomes less imperative for digital health companies pursuing innovative ways to make an impact.

Where’s the Evidence? Barriers to Analyzing Digital Health’s Impact

Meridith Peratikos is the Director of Enterprise Research at axialHealthcare, a pain medication, and pain care solutions company. Meridith Peratikos leads a team that conducts research studies, methodological oversight, and literature review. Prior to joining axialHealthcare, Meridith was a biostatistician and protocol manager for multi-center clinical trials conducted through the American College of Radiology Imaging Network at Brown University. She served full-time as a faculty member at Vanderbilt University Medical Center (VUMC) Department of Biostatistics, where she primarily collaborated within the Vanderbilt Institute for Global Health on observational cohort research in HIV/AIDS. 

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print

Tagged With: Axial Healthcare, Care Coordination, clinical research, Clinical Trials, digital health, global health, Intellectual Property, medication, patient engagement, Population Health, Population health management, radiology, Rock Health, telemedicine, white paper

Tap Native

Get in-depth healthcare technology analysis and commentary delivered straight to your email weekly

Reader Interactions

Primary Sidebar

Subscribe to HIT Consultant

Latest insightful articles delivered straight to your inbox weekly.

Submit a Tip or Pitch

Featured Insights

2025 EMR Software Pricing Guide

2025 EMR Software Pricing Guide

Featured Interview

Kinetik CEO Sufian Chowdhury on Fighting NEMT Fraud & Waste

Most-Read

CureIS Healthcare Sues Epic: Alleges Anti-Competitive Practices & Trade Secret Theft

The Evolving Role of Physician Advisors: Bridging the Gap Between Clinicians and Administrators

The Evolving Physician Advisor: From UM to Value-Based Care & AI

UnitedHealth Group Names Stephen Hemsley CEO as Andrew Witty Steps Down

UnitedHealth CEO Andrew Witty Steps Down, Stephen Hemsley Returns as CEO

Omada Health Files for IPO

Omada Health Files for IPO

Blue Cross Blue Shield of Massachusetts Launches "CloseKnit" Virtual-First Primary Care Option

Blue Cross Blue Shield of Massachusetts Launches “CloseKnit” Virtual-First Primary Care Option

Osteoboost Launches First FDA-Cleared Prescription Wearable Nationwide to Combat Low Bone Density

Osteoboost Launches First FDA-Cleared Prescription Wearable Nationwide to Combat Low Bone Density

2019 MedTech Breakthrough Award Category Winners Announced

MedTech Breakthrough Announces 2025 MedTech Breakthrough Award Winners

WeightWatchers Files for Bankruptcy to Eliminate $1.15B in Debt

WeightWatchers Files for Bankruptcy to Eliminate $1.15B in Debt

KLAS: Epic Dominates 2024 EHR Market Share Amid Focus on Vendor Partnership; Oracle Health Sees Losses Despite Tech Advances

KLAS: Epic Dominates 2024 EHR Market Share Amid Focus on Vendor Partnership; Oracle Health Sees Losses Despite Tech Advances

'Cranky Index' Reveals EHR Alert Frustration Peaks Midweek, Highest Among Admin Staff

‘Cranky Index’ Reveals EHR Alert Frustration Peaks Midweek, Highest Among Admin Staff

Secondary Sidebar

Footer

Company

  • About Us
  • Advertise with Us
  • Reprints and Permissions
  • Submit An Op-Ed
  • Contact
  • Subscribe

Editorial Coverage

  • Opinion
  • Health IT
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Population Health Management
    • Revenue Cycle Management
  • Digital Health
    • Artificial Intelligence
    • Blockchain Tech
    • Precision Medicine
    • Telehealth
    • Wearables
  • Startups
  • Value-Based Care
    • Accountable Care
    • Medicare Advantage

Connect

Subscribe to HIT Consultant Media

Latest insightful articles delivered straight to your inbox weekly

Copyright © 2025. HIT Consultant Media. All Rights Reserved. Privacy Policy |