• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

  • Opinion
  • Health IT
    • Behavioral Health
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Patient Engagement
    • Population Health Management
    • Revenue Cycle Management
    • Social Determinants of Health
  • Digital Health
    • AI
    • Blockchain
    • Precision Medicine
    • Telehealth
    • Wearables
  • Startups
  • M&A
  • Value-based Care
    • Accountable Care (ACOs)
    • Medicare Advantage
  • Life Sciences
  • Research

Why ML Monitoring is Essential to AI Success in Healthcare

by Krishnaram Kenthapadi, Chief Scientist at Fiddler AI 01/10/2023 Leave a Comment

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print
Krishnaram Kenthapadi, Chief Scientist at Fiddler AI

Artificial intelligence (AI) adoption in the healthcare sector has grown significantly over the last decade, with no signs of slowing down. According to a 2021 report from HIMSS, 62% of clinicians are interested in using AI/ML tools. 

From front-line workers to back-office staff, every stakeholder in the healthcare continuum can leverage AI technology to enhance healthcare quality. In fact, ML models are already being used to collect and analyze patient data at scale, thereby allowing healthcare organizations to reduce human error and streamline physician workflows. The significant benefit of this technology is that clinicians have more time for hands-on patient engagement.

AI is also able to ingest patient health information to fuel ML models that can identify correlations between assumed diseases and other patients’ symptoms. This gives doctors a stronger understanding of underlying disease patterns and can ultimately lead to better health outcomes for patients.

However, the true power of AI in healthcare will only be realized if ML models function properly and as predicted over the long run. Ensuring consistent and accurate model performance requires constant monitoring–something that healthcare organizations need to prioritize. 

Why is Model Monitoring Important?

An ML model is a type of algorithm that combs through large volumes of data to find patterns or make predictions. As real-world inputs change that data (for example, when the pandemic first started and made prior patient data obsolete), the models inevitably decay. Such changes can render ML models inaccurate, useless, and potentially unsafe—particularly for medical practitioners and doctors. 

Without ML model monitoring, healthcare practitioners can end up blindly following faulty predictions or patterns that don’t exist. Model monitoring is about identifying changes and asking, “Is something different in the world that might be invalidating our original assumptions that were used to train the model?” Through monitoring, teams can detect distributional shifts, for example, in the way that doctors describe similar symptoms. With this deeper insight, healthcare practitioners can improve accuracy related to recognizing patterns, as illness variants change and spread.

ML model monitoring is especially important for applications involving natural language processing (NLP) and computer vision (CV)–both of which work with forms of unstructured data. The former refers to the ability of AI to understand human language as it is spoken and written. The latter culls meaning from digital images, videos, and other visual inputs. 

A majority of healthcare data is stored in physicians’ notes, X-ray images, CT scans, and similar forms. Therefore, being able to mine large volumes of unstructured data is immensely valuable for modern healthcare organizations, which means they’re often deploying AI tools with NLP and CV capabilities. Monitoring with NLP and CV gives healthcare providers the ability to identify changes in data that occur in doctors’ notes and other unstructured forms (e.g., text, images, videos) where it was previously hard to measure change. 

Let’s take COVID-19 as an example of the role model monitoring with NLP and CV can play in healthcare. Say a developer is creating a model that ingests doctor’s notes and uses the data to identify patterns of disease for more precise illness detection. Prior to COVID-19, if a doctor’s notes involved a patient who had flu-like symptoms, the model would identify this as being a case of the flu. However, after the pandemic hit, models had to be retrained with the knowledge that flu-like symptoms could also be indicative of a case of COVID-19. Without this monitoring and retraining, the model wouldn’t reflect the current state of the world or enable better decision-making. 

As a result, many are turning to solutions like Model Performance Management (MPM) that can monitor every model in pre- and post-production to help practitioners make more efficient, less error-prone health decisions. The most sophisticated MPM platforms help engineers monitor NLP and CV and pick up on nuanced data drift quickly. 

Healthcare has come a long way in operationalizing AI technologies to enhance physician efficiency and improve patient outcomes. However, in order to successfully leverage ML, healthcare organizations will need to monitor their models to ensure they’re functioning correctly. With the right tools in place that can automatically identify and alert users of changes in both structured and unstructured data, healthcare practitioners will be able to confidently deploy models that could change the world of medicine for the better. 


About Krishnaram Kenthapadi 

Krishnaram Kenthapadi is the Chief Scientist of Fiddler AI, an enterprise startup building a responsible AI and ML monitoring platform. Previously, he was a Principal Scientist at Amazon AWS AI, where he led the fairness, explainability, privacy, and model understanding initiatives in Amazon AI platform. Prior to joining Amazon, he led similar efforts at the LinkedIn AI team, and served as LinkedIn’s representative in Microsoft’s AI and Ethics in Engineering and Research (AETHER) Advisory Board.

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print

Tagged With: Advisory Board, AI, AI in healthcare, Amazon, Artificial Intelligence, Healthcare Data, himss, HIT, Machine Learning, Microsoft, model, NLP, patient engagement, physicians, unstructured data

Tap Native

Get in-depth healthcare technology analysis and commentary delivered straight to your email weekly

Reader Interactions

Primary Sidebar

Subscribe to HIT Consultant

Latest insightful articles delivered straight to your inbox weekly.

Submit a Tip or Pitch

Featured Insights

2025 EMR Software Pricing Guide

2025 EMR Software Pricing Guide

Featured Interview

Kinetik CEO Sufian Chowdhury on Fighting NEMT Fraud & Waste

Most-Read

2019 MedTech Breakthrough Award Category Winners Announced

MedTech Breakthrough Announces 2025 MedTech Breakthrough Award Winners

WeightWatchers Files for Bankruptcy to Eliminate $1.15B in Debt

WeightWatchers Files for Bankruptcy to Eliminate $1.15B in Debt

KLAS: Epic Dominates 2024 EHR Market Share Amid Focus on Vendor Partnership; Oracle Health Sees Losses Despite Tech Advances

KLAS: Epic Dominates 2024 EHR Market Share Amid Focus on Vendor Partnership; Oracle Health Sees Losses Despite Tech Advances

'Cranky Index' Reveals EHR Alert Frustration Peaks Midweek, Highest Among Admin Staff

‘Cranky Index’ Reveals EHR Alert Frustration Peaks Midweek, Highest Among Admin Staff

Madison Dearborn Partners to Acquire Significant Stake in NextGen Healthcare

Madison Dearborn Partners to Acquire Significant Stake in NextGen Healthcare

Wandercraft Begins Clinical Trials for Physical AI-Powered Personal Exoskeleton

Wandercraft Begins Clinical Trials for Physical AI-Powered Personal Exoskeleton

Chipiron Secures $17M to Transform MRI Access with Portable Scanner

Chipiron Secures $17M to Transform MRI Access with Portable Scanner

Abbott to Integrate FreeStyle Libre Glucose Data with Epic EHR

Abbott to Integrate FreeStyle Libre Glucose Data with Epic EHR

5 Ways New Trump Administration Tariffs Are Impacting U.S. Healthcare Now

5 Ways Trump Administration Tariffs Are Impacting U.S. Healthcare Now

iCAD, GE HealthCare Integrate to Advance Breast Cancer Detection with AI

RadNet to Acquire iCAD for $103M in All-Stock Transaction

Secondary Sidebar

Footer

Company

  • About Us
  • Advertise with Us
  • Reprints and Permissions
  • Submit An Op-Ed
  • Contact
  • Subscribe

Editorial Coverage

  • Opinion
  • Health IT
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Population Health Management
    • Revenue Cycle Management
  • Digital Health
    • Artificial Intelligence
    • Blockchain Tech
    • Precision Medicine
    • Telehealth
    • Wearables
  • Startups
  • Value-Based Care
    • Accountable Care
    • Medicare Advantage

Connect

Subscribe to HIT Consultant Media

Latest insightful articles delivered straight to your inbox weekly

Copyright © 2025. HIT Consultant Media. All Rights Reserved. Privacy Policy |