Surveys
Types of Surveys
Data Collection by Survey
Survey Safety
Multiple Comparison Tests
Reliability and Validity
You might also read
Articles linked to this work by shared authors, journal, and citation graph.
Updated: Jun 13, 2026

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters
Published on: November 22, 2019
Daniel Gottliebson1, Natasha Layton, Erin Wilson
1Momentech Software Services, Caulfield East, Victoria, Australia.
This study evaluates how well common online survey platforms accommodate people who use assistive technology. Researchers found that most commercial tools fail to meet accessibility standards, leading to the development of a new, inclusive survey platform. The findings suggest that current design guidelines are insufficient to ensure true usability for all participants.
Area of Science:
Background:
Digital data collection often excludes individuals relying on specialized hardware or software interfaces. Prior research has shown that many web-based platforms lack compatibility with common screen readers. That uncertainty drove investigators to examine the functional limitations of existing commercial products. No prior work had resolved why these platforms frequently fail to support diverse user needs. This gap motivated a systematic evaluation of current market offerings. It was already known that accessibility claims by developers often diverge from actual user experiences. The researchers identified a persistent disconnect between compliance standards and practical utility. Such discrepancies highlight a significant barrier to inclusive research practices across various digital domains.
Purpose Of The Study:
The aim of this study is to evaluate the effectiveness of online survey tools for individuals who rely on assistive technology. Researchers sought to determine if commercially available platforms adequately support diverse user needs. This investigation was motivated by concerns that current digital tools often exclude significant portions of the population. The team identified a critical disconnect between developer claims and the actual usability of these products. They intended to highlight the limitations inherent in existing software architectures regarding inclusive design. By analyzing eleven popular platforms, the authors aimed to document the specific barriers faced by disabled participants. This work also sought to provide a practical, inclusive alternative for broad population data collection. The study ultimately aims to inform better design practices for future digital research instruments.
Main Methods:
Review Approach involved a comparative effectiveness analysis of eleven widely used digital platforms. The investigators recruited a diverse cohort of individuals who rely on assistive technology for daily web navigation. This team assessed each platform against a comprehensive set of established accessibility benchmarks. They specifically tested for screen reader compatibility and overall interface navigation efficiency. The researchers then synthesized these findings to identify common failures in existing commercial software. Based on these insights, they engineered a bespoke solution to prioritize inclusive design principles. This custom platform underwent iterative testing to ensure it met all identified usability criteria. The design process focused on bridging the gap between functional breadth and universal access requirements.
Main Results:
Key Findings From the Literature indicate that most commercial platforms fail to provide adequate support for assistive technology users. The analysis revealed that only one out of eleven examined platforms successfully met all established compliance points. However, this single compliant tool suffered from significant limitations, including an inflexible layout and a restricted range of question types. The researchers observed that many platforms claiming accessibility status do not reflect this in actual user performance. Several tools proved completely unusable for participants who rely on screen readers for navigation. The findings demonstrate a consistent compromise where developers sacrifice accessibility to maintain broad functionality. This results in a systematic exclusion of people living with disabilities from digital data collection efforts. The data suggest that current compliance standards are insufficient to guarantee a functional experience for all users.
Conclusions:
Synthesis and Implications suggest that current industry standards fail to guarantee functional inclusivity for disabled populations. The authors propose that existing compliance frameworks require substantial revision to address real-world usage barriers. Their review indicates that developers frequently prioritize broad functionality over the needs of assistive technology users. This synthesis highlights how current tools often force a trade-off between complex features and basic accessibility. The researchers argue that inclusive design must become a primary objective rather than an afterthought in software development. Their findings imply that many digital datasets may be inherently biased due to the exclusion of specific demographic groups. The authors conclude that bespoke solutions remain necessary until commercial platforms adopt more rigorous, user-centered design protocols. Future efforts should focus on integrating diverse user feedback directly into the early stages of platform architecture.
The researchers propose that most commercial platforms fail to support screen readers effectively. Only one of the eleven evaluated tools met all compliance benchmarks, yet that specific option lacked flexible layout features and diverse question formats, demonstrating a persistent trade-off between accessibility and functional breadth.
The study utilized a bespoke survey tool designed to meet comprehensive accessibility guidelines. This custom solution was developed through direct collaboration with individuals using a wide range of assistive technology to ensure the interface accommodated diverse input methods and navigation requirements.
The authors suggest that screen reader compatibility is a technical necessity for inclusive data collection. They observed that several platforms were entirely unusable by participants relying on these tools, which effectively silences the voices of people living with disabilities in research datasets.
The researchers employed a comparative effectiveness analysis of eleven popular platforms. This data type allowed the team to contrast industry-standard claims against the practical experiences of participants who rely on assistive technology to navigate digital interfaces.
The team measured compliance against established accessibility guidelines. They discovered that even when platforms implemented these standards, the tools often remained difficult to navigate, indicating that current benchmarks are insufficient for ensuring a truly usable experience for all participants.
The researchers propose that the absence of disabled individuals in survey data stems from inadequate design. They claim that current accessibility guidelines fall short of assuring usable tools, suggesting that developers must adopt more inclusive, user-centered approaches to capture a representative population.