Measuring 3-D understanding on the Web and in the laboratory

Area of Science:

• Cognitive Psychology
• Educational Measurement

Background:

• Assessing three-dimensional (3-D) spatial reasoning is crucial in STEM fields.
• Existing methods for evaluating 3-D understanding from 2-D representations are limited.
• Developing reliable and accessible psychometric tools is an ongoing need.

Purpose of the Study:

• To describe the development of a psychometric test measuring understanding of three-dimensional (3-D) concepts from drawings.
• To evaluate the reliability and performance differences between laboratory- and Web-based administration of the test.

Main Methods:

• The study involved developing a psychometric test with six subtests, including tasks on true length.
• Performance was measured by accuracy and response time.
• Data were collected using both traditional laboratory and novel Web-based delivery methods.

Main Results:

• High reliability coefficients were observed for both accuracy (0.90-0.96) and response time (0.87-0.95) across delivery methods.
• Web-based participants consistently achieved lower overall scores compared to laboratory participants.
• Significant differences in scores were noted between the two delivery methods.

Conclusions:

• The developed psychometric test demonstrates high reliability for assessing 3-D concept understanding.
• Web-based administration presents unique challenges, including lower participant scores and recruitment difficulties.
• Further research is needed to reconcile performance discrepancies between laboratory and Web-based testing environments.