Related Experiment Video
Updated: Aug 3, 2025
05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.1K
Evaluating the Impact of Uncertainty Visualization on Model Reliance.
IEEE Transactions on Visualization and Computer Graphics
|April 7, 2023
Summary
People
Area of Science:
- Human-Computer Interaction
- Machine Learning
- Decision Support Systems
Background:
- Machine learning models are increasingly used as decision support tools.
- Trust in machine learning outputs is crucial for effective automation.
- Visualization techniques can enhance user trust and appropriate reliance.
Purpose of the Study:
- To evaluate the impact of uncertainty visualization on user trust and reliance.
- To investigate the influence of task difficulty on model reliance.
- To compare different methods of visualizing machine uncertainty.
Main Methods:
- An experiment was conducted using Amazon's Mechanical Turk platform.
- Participants performed a college admissions forecasting task.
- Two uncertainty visualization techniques were tested under varying task difficulties.
Main Results:
- Model reliance is influenced by task difficulty and the level of machine uncertainty.
- Ordinal visualizations of model uncertainty better calibrated user behavior.
- Cognitive accessibility of visualizations affects reliance on decision support tools.
Conclusions:
- Effective uncertainty visualization is key to appropriate use of machine learning.
- Task difficulty and perceived model performance impact user trust.
- Designing accessible and informative visualizations is essential for decision support systems.
More Related Videos
Related Concept Videos
00:59Uncertainty: Overview
616
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
616
00:54Uncertainty: Confidence Intervals
4.2K
The confidence interval is the range of values around the mean that contains the true mean. It is expressed as a probability percentage. The interpretation of a 95% confidence interval, for instance, is that the statistician is 95% confident that the true mean falls within the interval. The upper and lower limits of this range are known as confidence limits. The confidence limits for the true mean are estimated from the sample's mean, the standard deviation, and the statistical factor...
4.2K
00:59Propagation of Uncertainty from Random Error
751
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
751
01:10Propagation of Uncertainty from Systematic Error
571
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
571
03:37Uncertainty in Measurement: Accuracy and Precision
74.1K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
74.1K
03:34Uncertainty in Measurement: Significant Figures
63.8K
All the digits in a measurement, including the uncertain last digit, are called significant figures or significant digits. Note that zero may be a measured value; for example, if a scale that shows weight to the nearest pound reads “140,” then the 1 (hundreds), 4 (tens), and 0 (ones) are all significant (measured) values.
63.8K