估计神经网络模型适配-A蒙特卡洛模拟研究的最小样本大小
Yongtian Cheng1, Konstantinos Vassilis Petrides1, Johnson Li2
1Division of Psychology and Language Sciences, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK.
Behavioral sciences (Basel, Switzerland)
|February 26, 2025
概括
神经网络 (NN) 与普通心理数据显示不稳定的性能. 研究人员建议避免对顺序独立变量进行NNs,特别是与非线性关系,因为结果不可靠.
科学领域:
- 心理学 心理学 心理学
- 计算机科学 计算机科学
- 机器学习 机器学习
- 心理测量 心理测量 心理测量
背景情况:
- 机器学习 (ML) 方法,特别是神经网络 (NN),在心理学研究中越来越多地用于对心理测量数据进行监督模型拟合.
- 心理测量独立变量通常是顺序和低维的,这给ML模型的性能带来了独特的挑战.
- 对于心理学中 NN 应用的样本大小规划缺乏指导.
研究的目的:
- 使用模拟的心理测量数据,研究不同样本大小的神经网络 (NN) 的性能.
- 根据性能标准,确定NN模型配件的适当的最小样本大小.
- 评估顺序独立变量的对心理研究中NN表现的影响.
主要方法:
- 进行了一项模拟研究,以评估不同样本大小的NN性能.
- 模拟包括变量之间的线性和非线性关系.
- 最小样本规模的性能标准被定义为95%的模型接近理论最大性能,80%的模型优于线性模型.
主要成果:
- 当使用顺序变量作为独立预测器时,神经网络性能被发现是不稳定的.
- 该研究确定了基于定义的绩效指标的具体样本大小建议.
- 结果表明,在心理学研究中使用常见的顺序数据NNs的潜在局限性.
结论:
- 神经网络可能不适合具有顺序独立变量的心理测量数据,特别是当存在非线性关系时.
- 研究人员应在将NN应用于此类数据集时谨慎行事.
- 需要进一步的研究来探索替代的ML方法或数据预处理技术,用于顺序心理测量数据.
更多相关视频
相关概念视频
Sample Size Calculation
3.2K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
3.2K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
38
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
38
Bootstrapping
576
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
576
Estimating Population Mean with Known Standard Deviation
8.2K
To construct a confidence interval for a single unknown population mean μ, where the population standard deviation is known, we need sample mean as an estimate for μ and we need the margin of error. Here, the margin of error (EBM) is called the error bound for a population mean (abbreviated EBM). The sample mean is the point estimate of the unknown population mean μ.
The confidence interval estimate will have the form as follows:
(point estimate - error bound, point estimate +...
The confidence interval estimate will have the form as follows:
(point estimate - error bound, point estimate +...
8.2K
Mechanistic Models: Compartment Models in Individual and Population Analysis
24
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
24
Distributions to Estimate Population Parameter
4.0K
The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...
4.0K


