Validation of an automated 16PF administration procedure

Area of Science:

• Psychological assessment
• Educational psychology
• Human-computer interaction

Background:

• The administration method of psychological assessments can influence their psychometric properties.
• Computer-based testing is increasingly prevalent, necessitating an understanding of its impact on personality measures.
• Previous research has explored computer administration, but direct comparisons with traditional formats on key psychometric indicators are crucial.

Purpose of the Study:

• To investigate the effects of computer-based versus booklet-based administration on the reliability and validity of a personality questionnaire.
• To assess differences in self-reported anxiety levels across various administration conditions.
• To evaluate participant perceptions of the assessment experience based on the administration format.

Main Methods:

• A counterbalanced repeated-measures design was employed with 80 undergraduates.
• The 16PF personality questionnaire (Form A) was administered under four conditions: computer-computer, computer-booklet, booklet-computer, and booklet-booklet.
• Self-report anxiety measures were collected before and after each administration, alongside ratings of the assessment experience.

Main Results:

• No significant differences were found in score reliability or validity between the computer and booklet administration formats.
• Self-reported anxiety levels did not differ significantly across the four administration conditions.
• Participants exposed to both computer and booklet formats reported a more positive experience with the computer-based assessment.

Conclusions:

• Computer-based administration of the 16PF is a psychometrically sound alternative to traditional booklet formats for undergraduates.
• The assessment experience may be enhanced by using computer-based methods, irrespective of prior format exposure.
• Further research is recommended to replicate these findings with clinical populations, such as treatment-seeking clients.