Development and Preliminary Evaluation of a Visual Annotation Tool to Rapidly Collect Expert-Annotated Weight Errors

P J Van Camp1,2, C Monifa Mahdi2, Lei Liu1,2

  • 1Department of Biomedical Informatics, University of Cincinnati, Cincinnati, OH, USA.

Insights

Incorrect patient weights in electronic health records (EHR) pose risks, especially for children. We developed a visual tool to efficiently collect expert-labeled weight errors, crucial for training machine learning algorithms to detect these errors.

Area of Science:

  • Biomedical Informatics
  • Machine Learning in Healthcare
  • Patient Safety

Background:

  • Incorrect patient weights entered into electronic health records (EHR) can lead to significant patient harm, particularly in pediatrics due to weight-based dosing.
  • Manual chart reviews for weight errors are impractical in clinical settings, and existing EHR alerts are insufficient.

Purpose of the Study:

  • To develop an advanced algorithm for detecting patient weight errors in EHR systems using supervised machine learning.
  • To design and preliminarily evaluate a visual annotation tool for rapid collection of expert-annotated weight errors.

Main Methods:

  • Agile software development methodology was employed to design the visual annotation tool.
  • The tool's design leveraged the observation that medical experts can readily identify infrequent weight errors.

Main Results:

  • Preliminary evaluation yielded positive user feedback on the visual annotation tool.
  • The tool successfully facilitated the initial collection of expert-annotated weight errors.

Conclusions:

  • The developed visual annotation tool is a promising approach for efficiently gathering labeled data for training machine learning algorithms to detect EHR weight errors.
  • Positive user feedback indicates readiness for a formal user-centered evaluation, paving the way for improved patient safety through accurate weight data.

Related Concept Videos

Genome Annotation and Assembly03:36

Genome Annotation and Assembly

The genome refers to all of the genetic material in an organism. It can range from a few million base pairs in microbial cells to several billion base pairs in many eukaryotic organisms. Genome assembly refers to the process of taking the DNA sequencing data and putting it all back together in a correct order to create a close representation of the original genome. This is followed by the identification of functional elements on the newly assembled genome, a process called genome annotation.
20.6K
Molecular Weight of Step-Growth Polymers01:08

Molecular Weight of Step-Growth Polymers

Step growth polymerization involves bi or multifunctional monomers. Bifunctional monomers react to form linear step growth polymers, whereas multifunctional monomers react to form non-linear or branched polymers.
As the step-growth polymerization involves step-wise condensation of monomers, the molecular weight also builds up eventually. Consequently, high molecular weight polymers are obtained at the late stages of the polymerization, where 99% of monomers have been consumed.
The extent of the...
2.7K
Run Charts01:12

Run Charts

Run charts serve as an essential instrument for visualizing the performance of various processes over time, enabling the identification of trends and patterns crucial for quality improvement. These charts map out a series of data points chronologically, offering insights into the stability and efficiency of a process. A run chart's creation involves plotting data points on a graph, with the time intervals on the horizontal axis and the specific measurements on the vertical axis. For...
276
The R Chart01:02

The R Chart

In statistical process control, control charts, particularly R charts, are instrumental in monitoring process variations and identifying non-random patterns that run charts might miss. R charts track the variability within process subgroups, which is crucial when standard deviation use is impractical or unknown process variations exist.
R charts are pivotal for pinpointing shifts in process variability. Stability is indicated when all data points remain within the defined upper and lower...
379
Interpreting R Charts01:22

Interpreting R Charts

R chart, or range chart, is a fundamental tool in statistical process control used to monitor the variability within a process. It complements the X-bar (x̄) chart by focusing on the range of the data, rather than individual values, providing a clear picture of the process dispersion over time.
An R chart plots the range of subsets of measurements collected from a process. Each point on the chart represents the range—defined as the difference between the maximum and minimum...
341
Pareto Chart00:52

Pareto Chart

A Pareto chart is a bar graph or a combination of both line and bar graphs. The bar lengths represent the individual values or the frequency, while the lines represent the cumulative total values. In this chart, the longest bars are arranged on the left and the shortest bars on the right, which makes it easier to read and interpret the data. It can also be called a Pareto diagram or Pareto analysis.
The Pareto chart is named after the Italian economist Vilfredo Pareto, who described the Pareto...
7.6K