How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology

Area of Science:

• Cognitive Psychology
• Psycholinguistics
• Computational Linguistics

Background:

• Conceptual properties norming studies (CPNs) generate data for semantic research and experimental stimuli.
• Current metrics derived from CPNs are point estimates, limiting analysis granularity.
• Researchers often overlook the inherent variability in these estimates.

Purpose of the Study:

• To reframe Conceptual Properties Norming Studies (CPNs) as parameter estimation procedures.
• To introduce a probabilistic ecological model for estimating CPN parameters and their variances.
• To challenge the traditional practice of equal participant distribution across concepts.

Main Methods:

• Applied a probabilistic model from ecology to CPN data analysis.
• Developed statistical expressions for parameter estimation and variance computation.
• Utilized CPN data to demonstrate the model's application and implications.

Main Results:

• Demonstrated that CPN metrics are point estimates with inherent variability.
• Showcased how the probabilistic model quantifies parameter variance.
• Provided evidence against the uniform distribution of participants across concepts.

Conclusions:

• Viewing CPNs through a parameter estimation lens allows for more fine-grained analyses.
• The proposed model enables accurate estimation of CPN parameters and their variances.
• This approach facilitates more robust comparisons of concepts within and across CPNs.