我的模式是不公平的,人们是否关心? 视觉设计影响机器学习中的信任和感知偏见
IEEE transactions on visualization and computer graphics
|October 25, 2023
概括
可视化设计会影响人们对机器学习 (ML) 模型偏见和信任的看法. 设计选择显著影响公平性和绩效优先级,性别发挥作用.
科学领域:
- 人与计算机的交互
- 机器学习伦理学 机器学习伦理学
- 数据可视化 数据可视化
背景情况:
- 机器学习 (ML) 模型越来越普遍,但往往含有偏见.
- 利益相关者需要工具来理解和评估ML模型的权衡,例如准确性与公平性.
- 可视化技术可以帮助理解这些复杂的模型特征.
研究的目的:
- 实证地调查可视化设计选择是否影响利益相关者对ML模型偏差的看法.
- 确定设计对机器学习模型的信任和采用它们的意愿的影响.
- 识别基于可视化的信任ML模型的用户策略.
主要方法:
- 对1500多名参与者进行了受控,众筹的实验.
- 分析了各种文本和视觉设计选择对模型感知的影响.
- 与不同性别如何优先考虑公平性和绩效进行了比较.
主要成果:
- 在优先考虑公平性和绩效方面观察到性别差异.
- 可视化设计显著改变了公平性和性能优先级.
- 对公平性的文本解释比条形图更有影响力;明确的偏见陈述超过了历史绩效数据.
结论:
- 可视化设计选择对于塑造对ML模型偏见和信任的看法至关重要.
- 根据用户人口统计和认知机制定制可视化可以改善ML模型的采用.
- 调查结果为各种利益相关者设计更有效的ML可视化系统提供了信息.
相关概念视频
Bias
4.3K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.3K
Factors Affecting Perception
1.6K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.6K
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Bias in Epidemiological Studies
314
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
314
Hindsight Biases
3.4K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
3.4K
Cause and Effect
10.9K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.9K


