Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.2K
Response Surface Methodology01:16

Response Surface Methodology

726
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
726

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Complexity and systems thinking in sport.

Journal of sports sciences·2024
Same author

Perceived impacts of stressful events on train driver performance.

Applied ergonomics·2024
Same author

Applying E/hf systems thinking to complex global problems.

Ergonomics·2024
Same author

Forecasting emergent risks in advanced AI systems: an analysis of a future road transport management system.

Ergonomics·2023
Same author

Managing the risks associated with technological disruption in the road transport system: a control structure modelling approach.

Ergonomics·2023
Same author

Using human factors and ergonomics methods to challenge the status quo: Designing for gender equitable research outcomes.

Applied ergonomics·2021
Same journal

Authority gradients in rail: A cross-jurisdictional systematic review and meta-synthesis.

Applied ergonomics·2026
Same journal

The distracting role of stress: Impaired executive attention and delayed fatigue perception.

Applied ergonomics·2026
Same journal

Analysis of work system components in interprofessional communication to determine shock etiology.

Applied ergonomics·2026
Same journal

Getting SSPOT to run: Development of a novel direct observational tool for usage in clinical settings.

Applied ergonomics·2026
Same journal

Investigating the impact of sopite syndrome on physiological responses during an immersive Augmented Reality (AR) game in a moving vehicle.

Applied ergonomics·2026
Same journal

The effect of aircraft cockpit rudder pedal shape on lower limb muscle activation, plantar pressure, and comfort.

Applied ergonomics·2026
See all related articles

Related Experiment Video

Updated: Feb 28, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K

Developing a contributing factor classification scheme for Rasmussen's AcciMap: Reliability and validity evaluation.

N Goode1, P M Salmon1, N Z Taylor1

  • 1Centre for Human Factors and Sociotechnical Systems, Faculty of Arts, Business and Law, University of the Sunshine Coast, Australia.

Applied Ergonomics
|June 15, 2017
PubMed
Summary
This summary is machine-generated.

A new classification scheme for accident analysis in led outdoor activities (LOA) shows promise but requires further development. Reliability and validity testing indicate current limitations for practitioners using the Accimap method.

Keywords:
Incident classificationReliabilitySystems thinkingValidity

More Related Videos

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K
Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

19.4K

Related Experiment Videos

Last Updated: Feb 28, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K
Development of a Virtual Reality Assessment of Everyday Living Skills
10:32

Development of a Virtual Reality Assessment of Everyday Living Skills

Published on: April 23, 2014

19.4K

Area of Science:

  • Safety Science
  • Risk Management
  • Human Factors

Background:

  • The Accimap method, while valuable for accident analysis, lacks a standardized classification scheme for contributing factors, hindering practitioner adoption.
  • Led Outdoor Activity (LOA) practitioners require a reliable tool to systematically identify and categorize factors contributing to incidents.
  • A two-level classification scheme (system and descriptor) was developed to support Accimap's application in LOA.

Purpose of the Study:

  • To evaluate the intra- and inter-rater reliability of the developed classification scheme.
  • To assess the criterion-referenced validity of the scheme against expert-defined codes.
  • To determine the suitability of the scheme for use by LOA practitioners.

Main Methods:

  • Eleven LOA practitioners independently applied the two-level classification scheme (14 system codes, 107 descriptor codes) to four incident reports on two separate occasions.
  • Intra-rater reliability was assessed by comparing each practitioner's coding on both occasions.
  • Inter-rater reliability was assessed by comparing coding across different practitioners.
  • Criterion-referenced validity was determined by comparing practitioner codes to those assigned by the Accimap method creators.

Main Results:

  • Acceptable mean intra-rater reliability was found at both system (83.6%) and descriptor (74%) levels.
  • Inter-rater reliability was inconsistently acceptable at the system level (68.8-73.9%) and poor at the descriptor level (58.5-64.1%).
  • Criterion-referenced validity was acceptable at the system level (73.9-75.3%) but inconsistently acceptable at the descriptor level (67.6-70.8%).

Conclusions:

  • The current classification scheme does not meet the required reliability and validity standards for effective use by LOA practitioners with the Accimap method.
  • Further refinement and development are necessary to enhance the scheme's psychometric properties.
  • The study highlights critical considerations for designing and validating future classification schemes in accident analysis.