Test-retest reliability and practice effects of a computerized neuropsychological battery: A solution-oriented
Sophie J M Rijnen1, Sophie D van der Linden1, Wilco H M Emons2
1Elisabeth-TweeSteden Hospital.
Psychological Assessment
|June 29, 2018
Summary
This study found varying reliability for the CNS Vital Signs (VS) neuropsychological test. Practice effects, particularly in cognitive flexibility and processing speed, were observed at 3 months but not 12 months.
Area of Science:
- Neuropsychology
- Cognitive Science
- Psychometrics
Background:
- The CNS Vital Signs (VS) is a widely used computerized neuropsychological test battery.
- Understanding its test-retest reliability and practice effects is crucial for accurate longitudinal assessment.
- Previous research has not fully elucidated these psychometric properties in healthy adult populations.
Purpose of the Study:
- To examine the test-retest reliabilities of the CNS VS.
- To investigate practice effects in healthy adults over 3- and 12-month intervals.
- To identify predictors of practice effects and provide methods for reliable change assessment.
Main Methods:
- 158 healthy Dutch adults were recruited.
- Participants completed the CNS VS at baseline and at 3- and 12-month follow-ups.
- Reliability coefficients and practice effects were analyzed, considering age, education, and retest interval.
Main Results:
- Test-retest reliability coefficients for CNS VS scores ranged from low to high.
- Significant practice effects were observed at the 3-month retest, particularly in Cognitive Flexibility, Processing Speed, and Reaction Time.
- No significant practice effects were found between the 3- and 12-month intervals.
- Age, education, and retest interval did not significantly predict practice effects.
Conclusions:
- The CNS VS demonstrates variable test-retest reliability.
- Practice effects are present in the short term (3 months) but not the long term (12 months) for healthy adults.
- New methods, such as Reliable Change Index (RCI) formulae, are needed to account for imperfect reliability and practice effects in longitudinal neuropsychological assessments.
Related Concept Videos
01:29Reliability and Validity
14.1K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.1K
03:12Batteries and Fuel Cells
31.0K
A battery is a galvanic cell that is used as a source of electrical power for specific applications. Modern batteries exist in a multitude of forms to accommodate various applications, from tiny button batteries such as those that power wristwatches to the very large batteries used to supply backup energy to municipal power grids. Some batteries are designed for single-use applications and cannot be recharged (primary cells), while others are based on conveniently reversible cell reactions that...
31.0K
03:26Framing Effects
8.0K
Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in...
8.0K
01:21DC Battery
1.3K
A conductor needs to be a component of a path that creates a closed loop or full circuit to have a continuous current flowing through it. A current starts to flow if an electric field is created inside an isolated conductor that is not part of a full circuit. The conductor quickly develops a net positive charge at one end and a net negative charge at the other. These charges generate an electric field opposite the direction of the applied electric field, which reduces the current. Eventually,...
1.3K
01:13Location and Orientation of the Heart
10.5K
The human heart, despite its modest size and weight, is an organ of remarkable strength and endurance. Roughly the size of a fist, the heart weighs between 250 and 350 grams and is nestled within the mediastinum, the medial cavity of the thorax. It extends obliquely for about 12 to 14 cm, resting on the superior surface of the diaphragm. The heart is positioned anterior to the vertebral column and posterior to the sternum, with two-thirds of its mass lying to the left of the midsternal line.
10.5K
01:25Distribution Reliability and Automation
519
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
519