• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

How eClinicalWorks Agentic AI Is Helping Revenue Cycle Leaders Improve Financial Performance
  • Opinion
  • Health IT
    • Behavioral Health
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Patient Engagement
    • Population Health Management
    • Revenue Cycle Management
    • Social Determinants of Health
  • Digital Health
    • AI
    • Blockchain
    • Precision Medicine
    • Telehealth
    • Wearables
  • Life Sciences
  • Investments
  • M&A
  • Value-based Care
    • Accountable Care (ACOs)
    • Medicare Advantage

John Snow Labs Launches Automated Testing for Responsible AI

by Syed Hamza Sohail 07/25/2024 Leave a Comment

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print

What You Should Know:

– John Snow Labs, the AI for healthcare company, today announced the release of Automated Responsible AI Testing Capabilities in the Generative AI Lab.

– This is a first-of-its-kind no-code tool to test and evaluate the safety and efficacy of custom language models. It enables non-technical domain experts to define, run, and share test suites for AI model bias, fairness, robustness, and accuracy.

Comprehensive Testing Solutions for AI in Healthcare and Life Sciences

John Snow Labs, a leading AI company for healthcare, provides advanced software, models, and data to enhance AI application in healthcare and life science organizations. The company is renowned for developing Spark NLP, Healthcare NLP, the Healthcare GPT LLM, the Generative AI Lab No-Code Platform, and the Medical Chatbot. Their award-winning medical AI software supports top pharmaceuticals, academic medical centers, and health technology companies globally.

John Snow Labs’ capabilities are built on the open-source LangTest library, which includes over 100 test types for various aspects of Responsible AI, such as bias, security, toxicity, and political leaning. LangTest leverages Generative AI to automatically generate test cases, allowing for a comprehensive set of tests to be produced in minutes rather than weeks. Designed specifically for testing custom AI models, LangTest addresses scenarios not covered by general-purpose benchmarks and leaderboards.

Recent US legislation has made comprehensive testing essential for companies aiming to release new AI-based products and services:

– The ACA Section 1557 Final Rule, effective June 2024, prohibits discrimination in medical AI algorithms based on race, color, national origin, gender, age, or disability.

– The HTI-1 Final Rule on transparency in medical decision support systems mandates companies to demonstrate how their models are trained and tested.

– The American Bar Association Guidelines require extensive internal and third-party audits before AI deployments, responding to lawsuits against companies providing models that match job descriptions with candidates’ resumes.

There is an urgent need for comprehensive testing solutions for Large Language Models (LLMs). Many domain experts lack the technical expertise to perform such testing, and many data scientists lack the domain expertise to build comprehensive, industry-specific models. The Generative AI Lab addresses this gap by enabling domain experts to create, edit, and understand model testing without the need for a data scientist. The tool incorporates best practices, including versioning, sharing, and automated test execution for every new model.

  • LinkedIn
  • Twitter
  • Facebook
  • Email
  • Print

Tagged With: Artificial Intelligence

Tap Native

Get in-depth healthcare technology analysis and commentary delivered straight to your email weekly

Reader Interactions

Primary Sidebar

Subscribe to HIT Consultant

Latest insightful articles delivered straight to your inbox weekly.

Submit a Tip or Pitch

Featured Insights

How eClinicalWorks Agentic AI Is Helping Revenue Cycle Leaders Improve Financial Performance

Most-Read

Innovaccer-CHIME 2030 Survey Reveals AI Will Automate Nearly Two-Thirds of Administrative Work and Do 3x the Work With the Same Staff

Innovaccer-CHIME 2030 Survey Reveals AI Will Automate Nearly Two-Thirds of Administrative Work and Do 3x the Work With the Same Staff

CB Insights’ 2026 Digital Health 50 Reveals How Agentic AI Is Becoming the Clinical Provider and Medication Access Engine

Oura Acquires Counsel Health for $625M: Scaling Continuous Biometrics into On-Demand Medical Care

M&A: Oura Acquires Counsel Health for $625M: Scaling Continuous Biometrics into On-Demand Medical Care

WittKieffer 2026 Healthcare CIO Survey: 82% Sit on Executive Teams, Yet Only 36% Have Formal Succession Plans

WittKieffer 2026 Healthcare CIO Survey: 82% Sit on Executive Teams, Yet Only 36% Have Formal Succession Plans

CVS Rebrands Health Services Segment, Launches Model for Retail Pharmacy Reimbursement

CVS Health Formalizes Tax-Free Split-Off to Carve Out CVS Pharmacy by 2028

SAMHSA and ONC Invest $20M in Behavioral Health IT Initiative

ONC Finalizes HTI-5 Deregulatory Rule to Cut $1.55B in Health IT Compliance and Accelerate FHIR APIs

Redesign Health Merges with Sheba Medical Center’s ARC Global and Agrees to Acquire AVIA

Redesign Health Merges with Sheba Medical Center’s ARC Global and Agrees to Acquire AVIA

Sword Acquires Headspace in All-Cash Deal Worth Up to $300M to Unify Physical and Mental AI Care

M&A: Sword Acquires Headspace in All-Cash Deal Worth Up to $300M to Unify Physical and Mental AI Care

M&A: Francisco Partners to Acquire Weave in $650M Take-Private Deal

M&A: Francisco Partners to Acquire Weave in $650M Take-Private Deal

Epic Launches One-Click Care Everywhere Diagnostic Image Exchange

Epic Launches One-Click Care Everywhere Diagnostic Image Exchange

Secondary Sidebar

Footer

Company

  • About Us
  • 2026 Editorial Calendar
  • Advertise with Us
  • Reprints and Permissions
  • Op-Ed Submission Guidelines
  • Contact
  • Subscribe

Editorial Coverage

  • Opinion
  • Health IT
    • Care Coordination
    • EMR/EHR
    • Interoperability
    • Population Health Management
    • Revenue Cycle Management
  • Digital Health
    • Artificial Intelligence
    • Blockchain Tech
    • Precision Medicine
    • Telehealth
    • Wearables
  • Startups
  • Value-Based Care
    • Accountable Care
    • Medicare Advantage

Connect

Subscribe to HIT Consultant Media

Latest insightful articles delivered straight to your inbox weekly

Copyright © 2026. HIT Consultant Media. All Rights Reserved. Privacy Policy |