Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Reproducible workflow for online artificial intelligence in digital health.

Susobhan Ghosh1, Bhanu T Gullapalli1, Daiqi Gao2

  • 1Department of Computer Science, School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA.

Philosophical Transactions. Series A, Mathematical, Physical, and Engineering Sciences
|May 28, 2026
PubMed
Summary

Related Concept Videos

Issues And Trends In Healthcare Delivery System01:29

Issues And Trends In Healthcare Delivery System

The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Non-equilibrium in the Cell01:16

Non-equilibrium in the Cell

An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Mobile intervention for emerging adults with regular cannabis use: a micro-randomized trial.

Lancet regional health. Americas·2026
Same author

Effective monitoring of online AI decision-making algorithms in just-in-time adaptive interventions.

NPJ digital medicine·2026
Same author

SigmaScheduling: Uncertainty-Informed Scheduling of Decision Points for Intelligent Mobile Health Interventions.

... International Conference on Wearable and Implantable Body Sensor Networks. International Conference on Wearable and Implantable Body Sensor Networks·2026
Same author

Non-Stationary Latent Auto-Regressive Bandits.

Reinforcement learning journal·2026
Same author

Asymptotic Inference for Multi-Stage Stationary Treatment Policy with Variable Selection.

Journal of machine learning research : JMLR·2026
Same author

Harnessing Causality in Reinforcement Learning With Bagged Decision Times.

Proceedings of machine learning research·2026

This article introduces a standardized, reproducible workflow for creating and managing artificial intelligence algorithms that learn continuously from streaming data in digital health applications. By addressing the challenges of iterative development, the authors provide a framework to ensure that these evolving systems remain auditable, consistent, and scientifically reliable over time.

Area of Science:

  • Digital health interventions research within online artificial intelligence systems
  • Computational methodology and software engineering for health informatics

Background:

No prior work had resolved the tension between maintaining algorithmic adaptability and ensuring scientific reproducibility in digital health. That uncertainty drove the need for structured frameworks when deploying systems that learn from streaming data. Prior research has shown that digital health interventions rely on continuous cycles of development, deployment, and optimization. This gap motivated a closer look at how iterative changes affect the reliability of decision-making tools. It was already known that streaming data collection allows for constant model updates in real-time environments. However, the lack of standardized practices often hinders the ability to audit algorithm behavior across different deployment phases. This challenge complicates efforts to compare results over time or verify the performance of evolving models. Consequently, the field requires a robust approach to manage the complexities inherent in modern, adaptive digital health technologies.

Purpose Of The Study:

Keywords:
digital health interventionsonline AI algorithmsreproducibilityalgorithmic reproducibilitystreaming data analysisdecision-making systemssoftware engineering

Frequently Asked Questions

The researchers propose a workflow that captures data and model states throughout the development cycle. By ensuring these elements are stored consistently, the system allows for accurate auditing of decision-making behaviors, which facilitates scientific discovery and trustworthy refinement of the algorithms over time.

The framework utilizes a structured approach to manage the entire lifecycle of an algorithm. This includes specific phases for development, deployment, and analysis, which are designed to handle the iterative nature of streaming data collection in digital health interventions.

The authors argue that accurate storage of data collected across deployments is necessary for scientific utility. Without this, it is impossible to compare algorithm behavior over time or conduct meaningful audits of the decision-making process in evolving digital health systems.

Related Experiment Videos

The aim of this article is to propose a reproducible scientific workflow for developing, deploying, and analyzing online artificial intelligence decision-making algorithms in digital health interventions. This work addresses the specific problem of balancing the adaptability of these algorithms with the need for scientific reproducibility. The authors seek to resolve the tension caused by continuous cycles of re-development and optimization in digital health. They are motivated by the rapid evolution of algorithms, sensors, and software that characterize this field. The study focuses on ensuring that data collected across deployments maintains its scientific utility through accurate storage. It also addresses the necessity of making algorithm behavior auditable to support trustworthy refinement. The researchers aim to provide a practical solution grounded in real-world deployment experiences. By doing so, they intend to facilitate scientific discovery and improve the reliability of decision-making tools in clinical or health-related contexts.

Main Methods:

The review approach synthesizes practical experiences from various real-world implementations to construct a comprehensive framework. This strategy focuses on identifying specific obstacles encountered during the iterative development of adaptive decision-making systems. The authors evaluate the entire lifecycle of these models, from initial creation to final deployment and subsequent analysis. By examining these phases, the team maps out necessary steps to maintain consistency in rapidly evolving environments. The design prioritizes the creation of auditable records for every stage of the algorithm's evolution. This methodology avoids reliance on static models, instead emphasizing the dynamic nature of streaming data inputs. The researchers utilize their collective insights to propose a standardized sequence of actions for practitioners. This systematic process aims to bridge the gap between continuous model optimization and the requirement for rigorous scientific documentation.

Main Results:

The key findings from the literature demonstrate that iterative deployment is a defining characteristic of modern digital health interventions. The authors identify that streaming data collection necessitates a shift toward more robust, auditable development practices. Their analysis reveals that without standardized storage, the scientific utility of data collected across multiple deployments is significantly diminished. The study highlights that algorithm behavior must be tracked to facilitate trustworthy refinement of decision-making processes. The researchers show that balancing adaptability with reproducibility is the primary challenge for current online systems. Their findings suggest that the proposed workflow effectively addresses these challenges across all phases of the algorithm life cycle. The evidence indicates that comparable results are achievable when developers implement the suggested documentation and storage protocols. These results underscore the importance of maintaining scientific rigor while allowing for the continuous improvement of digital health tools.

Conclusions:

The authors propose a structured workflow to enhance the scientific utility of adaptive algorithms in digital health. This framework addresses reproducibility challenges by ensuring that data and model states are captured throughout the lifecycle. The researchers suggest that consistent storage practices allow for accurate auditing of decision-making behaviors across multiple deployments. By facilitating comparable results, the proposed method supports trustworthy refinement of these evolving systems. The authors emphasize that their approach is grounded in practical experience gained from diverse real-world implementations. This synthesis implies that standardized documentation is necessary for scientific discovery in rapidly changing digital environments. The workflow provides a path for developers to balance the need for model improvement with the requirement for transparency. Ultimately, the authors conclude that their systematic approach offers a viable solution for maintaining integrity in online artificial intelligence applications.

The authors use data collected from multiple real-world deployments to ground their proposed workflow. This practical experience informs the design of the framework, ensuring it addresses the actual challenges encountered when implementing adaptive algorithms in clinical or health-related settings.

The researchers measure the success of their approach by its ability to facilitate comparable results over time. This phenomenon is essential for verifying that improvements in algorithm performance are genuine and for maintaining transparency as the models continue to learn from new streaming data.

The authors claim that their workflow provides a path for developers to balance model improvement with transparency. They suggest that this systematic approach is a viable solution for maintaining scientific integrity in online artificial intelligence applications within the digital health sector.