Related Experiment Video
Updated: Jan 23, 2026
05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.5K
Validation of Embedded Experience Sampling (EES) for Measuring Non-cognitive Facets of Problem-Solving Competence in
Andreas Rausch1, Kristina Kögler2, Jürgen Seifried3
1Economic and Business Education - Workplace Learning, Business School, University of Mannheim, Mannheim, Germany.
Frontiers in Psychology
|June 11, 2019
Summary
We developed Embedded Experience Sampling (EES), a new method to measure non-cognitive aspects of competence. EES collects data during assessments, proving valid and reliable for measuring skills beyond cognitive abilities.
Area of Science:
- Educational Psychology
- Psychometrics
- Vocational Education and Training (VET)
Background:
- Domain-specific problem-solving competence includes non-cognitive facets like interest and self-concept.
- Non-cognitive facets are often neglected or measured with detached questionnaires.
- Integrated measurement of cognitive and non-cognitive facets is needed.
Purpose of the Study:
- To develop and test the Embedded Experience Sampling (EES) method for measuring non-cognitive facets of competence.
- To evaluate the feasibility, validity, and potential biases of the EES method.
- To compare EES data with other measurement sources.
Main Methods:
- Developed and implemented the EES method in three studies within commercial vocational education and training (VET).
- Collected data during scenario-based, low-stakes assessments using embedded EES items.
- Employed a multitrait-multimethod approach and Item Response Theory (IRT) for validity analysis.
Main Results:
- EES events were perceived positively by test-takers, with no significant social desirability bias or additional burden.
- Construct validity of EES was supported by correlation analysis and IRT modeling.
- EES data showed substantial correlations with test motivation but minimal correlation with generalized retrospective self-reports.
Conclusions:
- Embedded Experience Sampling (EES) offers a valid alternative for measuring non-cognitive facets of competence in low-stakes assessments.
- EES data provides unique insights into affective and motivational dispositions during task performance.
- The method's self-report nature may limit its use in high-stakes testing scenarios.
Keywords:
business simulationcompetence assessmentcomputer-based assessmentembedded experience samplingnon-cognitive facetsproblem solvingscenario-based assessmentMore Related Videos
10:13Assessment of Age-related Changes in Cognitive Functions Using EmoCogMeter, a Novel Tablet-computer Based Approach
Published on: February 14, 2014
14.1K
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
4.4K
Related Concept Videos
01:28Pipe Flowrate Measurement: Problem Solving
827
A spray tank system is engineered to uniformly distribute a pest-control liquid across plants by using a pressurized mechanism. The tank, pressurized to 150 kPa, holds the pesticide at a height of 0.80 meters. Liquid flows from the tank through a 1.9 meter pipe with a diameter of 0.015 meters, angled at 0.698 radians, ultimately reaching a 0.007 meter nozzle that sprays the pesticide. Accurate calculation of the system's flow rate is crucial to ensure uniform application, and this is achieved...
827
01:29Reliability and Validity
13.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.8K
01:38Cognitive Dissonance
36.8K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
36.8K
01:29Problem-Solving
510
Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies:
510
01:03Data Validation
6.4K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.4K
01:15Data Validation
695
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
695