Evaluation of Accessibility Testing Methods. Which Methods Uncover What Type of Problems?

Area of Science:

• Human-Computer Interaction
• Usability Engineering
• Information Technology

Background:

• Accessibility evaluation is vital for digital solutions.
• Existing methods vary in resource and knowledge requirements.
• Classifying methods aids in selection and application.

Purpose of the Study:

• To categorize fourteen accessibility evaluation methods.
• To assess the effectiveness of diverse methods in identifying issues.
• To inform the selection of appropriate methods for future evaluations.

Main Methods:

• Categorized fourteen accessibility evaluation methods by resource needs and focus (technical vs. usable).
• Selected four distinct methods for evaluating an electronic identification (e-ID) solution.
• Identified and analyzed confusing and critical accessibility issues.

Main Results:

• Each of the four selected methods uncovered unique accessibility issues.
• Significant overlap in identified issues was observed across methods.
• No single method identified more than half of the total issues found.

Conclusions:

• A comprehensive approach combining multiple evaluation methods is necessary for thorough accessibility assessments.
• Method selection should align with specific project goals and available resources.
• Findings provide guidance for optimizing future accessibility evaluations.