国際オンライン教育評価システムからのログデータの分析:アクションシーケンス間の反応時間に対する多州生存モデリングアプローチ
Jina Park1,2, Ick Hoon Jin1,2, Minjeong Jeon3
1Department of Applied Statistics, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea.
Psychometrika
|September 1, 2025
まとめ
この研究では,オンラインの評価ログデータを分析するために,複数の状態の生存モデル (MSM) を導入します. このモデルは,受験者に対する要因の影響を明らかにする.
科学分野:
- 教育に関する測定
- サイコメトリクス
- データサイエンス
背景:
- コンピュータベースの評価は,広範なログデータを生成します.
- このデータを分析すると テスト受験者の問題解決プロセスに 洞察が得られます
- 既存の方法は,アクションシーケンスのダイナミクスを完全に捉えることができないかもしれません.
研究 の 目的:
- 評価ログからのアクションシーケンスデータを分析するための新しいマルチ状態生存モデル (MSM) を提案する.
- 試験受験者の行動間の移行速度に影響を与える要因を調査する.
- 問題解決の正しいパターンと誤ったパターンを区別する重要な行動を特定する.
主な方法:
- ログファイルのアクションシーケンスの複数状態生存モデル (MSM) を開発した.
- 連続したアクションの間の反応時間をモデル化.
- 正解と不正解のグループ間の移行確率を比較した.
- モデルの検証のためにシミュレーション研究と感度分析を用いた.
- 大人の国際能力評価プログラム (PIAAC) のデータにモデルを適用した.
主要な成果:
- MSMは行動間の移行速度を効果的にモデル化しています.
- 正解と不正解を区別する具体的な行動
- 正解と不正解の軌跡に関連した 明確な問題解決パターンを明らかにしました
- このモデルはシミュレーションと感受性分析を通じて堅実性を示した.
結論:
- 提案されたMSMは,コンピュータベースの評価で複雑な問題解決行動を分析するための強力なツールを提供します.
- 行動移行のダイナミクスを理解することで,診断フィードバックと評価デザインを向上させることができます.
- このアプローチは,PIAACデータで示された,評価中の認知プロセスの微妙な見方を提供します.
関連する概念動画
Introduction To Survival Analysis
394
Survival analysis is a statistical method used to study time-to-event data, where the "event" might represent outcomes like death, disease relapse, system failure, or recovery. A unique feature of survival data is censoring, which occurs when the event of interest has not been observed for some individuals during the study period. This requires specialized techniques to handle incomplete data effectively.
The primary goal of survival analysis is to estimate survival time—the time...
The primary goal of survival analysis is to estimate survival time—the time...
394
Comparing the Survival Analysis of Two or More Groups
280
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
280
Assumptions of Survival Analysis
196
Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
196
Survival Curves
308
Survival curves are graphical representations that depict the survival experience of a population over time, offering an intuitive way to track the proportion of individuals who remain event-free at each time point. These curves are widely used in fields such as medicine, public health, and reliability engineering to visualize and compare survival probabilities across different groups or conditions.
The Kaplan-Meier estimator is the most common method for constructing survival curves. This...
The Kaplan-Meier estimator is the most common method for constructing survival curves. This...
308
Censoring Survival Data
228
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
228
Actuarial Approach
132
The actuarial approach, a statistical method originally developed for life insurance risk assessment, is widely used to calculate survival rates in clinical and population studies. This method accounts for participants lost to follow-up or those who die from causes unrelated to the study, ensuring a more accurate representation of survival probabilities.
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
132


