探索删除 (或保留) 偏差项目的影响:基于分类准确性的程序
1University of Southern California, Los Angeles, USA.
Assessment
|December 10, 2024
概括
本研究引入了项目级效果大小指数,以评估项目删除对心理测试公平性和绩效的影响. 新方法和R包无偏见地帮助在测试开发和应用中做出明智的决策.
科学领域:
- 心理测量 心理测量 心理测量
- 心理测量 心理测量
- 统计建模 统计建模
背景情况:
- 心理测试对于高风险环境中的个人分类至关重要.
- 测量不变性对于有效的群组比较至关重要,但在实践中很少实现.
- 现有的分类准确性框架可能无法完全解决分类中的项目级偏差.
研究的目的:
- 开发项目级影响大小指数,以量化项目删除对测试公平性和性能的影响.
- 为测试开发人员和用户在处理测量不变性时提供实际指导.
- 为了实施这些新方法,引入R包"unbiasr".
主要方法:
- 项目级影响大小指数的发展.
- 量化项目删除/保留对测试性能和公平性的影响.
- 拟议指数的说明性示例应用.
- 在R包"unbiasr"中的方法的实施.
主要成果:
- 拟议的索引允许对保留或删除项目的知情决定.
- 量化了提高公平性和保持测试性能之间的权衡.
- 证明了"unbiasr"套餐的实际实用性.
结论:
- 项目级分析提供了一种更细致的方法来解决心理测试中的测量不变性问题.
- 开发的指数和"unbiasr"包为提高测试分类公平性和有效性提供了有价值的工具.
- 关于项目管理的知情决策可以优化测试公平性和性能.
更多相关视频
12:18A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
7.5K
08:05A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers
Published on: January 5, 2018
9.7K
相关概念视频
Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
Confirmation Biases
5.4K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.4K
Accuracy and Errors in Hypothesis Testing
175
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
175
Bias in Epidemiological Studies
155
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
155
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
