Related Experiment Video
Updated: Jun 22, 2025

Computerized Adaptive Testing System of Functional Assessment of Stroke
Published on: January 7, 2019
TORONTO: A trial-oriented multidimensional psychometric testing algorithm
Runjie Bill Shi1,2,3, Moshe Eizenman4,5, Leo Yan Li-Han6,7
1Institute of Biomedical Engineering, University of Toronto, Toronto, Canada.
Abstract:
Bayesian adaptive methods for sensory threshold determination were conceived originally to track a single threshold. When applied to the testing of vision, they do not exploit the spatial patterns that underlie thresholds at different locations in the visual field. Exploiting these patterns has been recognized as key to further improving visual field test efficiency. We present a new approach (TORONTO) that outperforms other existing methods in terms of speed and accuracy. TORONTO generalizes the QUEST/ZEST algorithm to estimate simultaneously multiple thresholds. After each trial, without waiting for a fully determined threshold, the trial-oriented approach updates not only the location currently tested but also all other locations based on patterns in a reference data set. Since the availability of reference data can be limited, techniques are developed to overcome this limitation. TORONTO was evaluated using computer-simulated visual field tests: In the reliable condition (false positive [FP] = false negative [FN] = 3%), the median termination and root mean square error (RMSE) of TORONTO was 153 trials and 2.0 dB, twice as fast with equal accuracy as ZEST. In the FP = FN = 15% condition, TORONTO terminated in 151 trials and was 2.2 times faster than ZEST with better RMSE (2.6 vs. 3.7 dB). In the FP = FN = 30% condition, TORONTO achieved 4.2 dB RMSE in 148 trials, while all other techniques had > 6.5 dB RMSE and terminated much slower. In conclusion, TORONTO is a fast and accurate algorithm for determining multiple thresholds under a wide range of reliability and subject conditions.
Related Concept Videos
Self-Report Tests of Personality
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Comparing Experimental Results: Student's t-Test

