通过监督主题模型,探索考生对构建的响应项目的反应
Seohyun Kim1, Zhenqiu Lu2, Allan S Cohen2
1Kaiser Permanente Mid-Atlantic Permanente Research Institute, Rockville, Maryland, USA.
The British journal of mathematical and statistical psychology
|September 13, 2023
概括
本研究引入了一个新的主题模型来分析来自评估的文本数据. 该模型识别了具有文本响应和分数之间的不同关系的子组,改进了对构建响应项目的分析.
科学领域:
- 教育测量教育的测量
- 自然语言处理自然语言处理.
- 统计建模 统计建模
背景情况:
- 文本数据在评估中越来越多地被使用,特别是构造响应 (CR) 项目.
- 自然语言处理 (NLP) 技术可以分析大型文本数据集.
- 概率主题模型,如监督潜伏迪里克莱特分配 (SLDA),分析文本中的潜伏主题结构.
研究的目的:
- 为了解决SLDA在不同人群中的同质关系假设的局限性.
- 引入一种新的监督主题模型,将有限混合模型与SLDA集成在一起.
- 检测潜伏的参与者子组与文字响应和分数之间的明显关系.
主要方法:
- 通过将有限混合模型纳入SLDA,开发了一个新的监督主题模型.
- 应用该模型来分析文本响应和中年级科学调查评估的分数.
- 在实际条件下进行模拟研究以评估模型性能.
主要成果:
- 拟议的模型成功地检测出潜在的参与者群体,这些参与者表现出不同的文本响应-得分关系.
- 用科学调查知识评估的一个例子来证明模型的实用性.
- 模拟结果为模型的性能提供了洞察力.
结论:
- 有限混合SLDA模型为分析文本评估数据提供了更细致的方法.
- 这种方法增强了对书面答复与绩效之间的关系中子组差异的理解.
- 该模型对教育测量和NLP应用有重大影响.
更多相关视频
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.2K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
802
相关概念视频
Response Surface Methodology
173
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
173
Stereotype Content Model
14.8K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.8K
Systematic Sampling Method
10.4K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
Systematic sampling is one of the simplest methods...
Systematic sampling is one of the simplest methods...
10.4K
Regression Analysis
5.8K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
5.8K
Typical Model Studies
380
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
380
Multiple Regression
3.0K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.0K
