Related Experiment Video
Updated: Jul 2, 2025

Iterative Development of an Innovative Smartphone-Based Dietary Assessment Tool: Traqq
Published on: March 19, 2021
Development and Validation of a Vocabulary Measure in the Mobile Toolbox
Stephanie Ruth Young1, Elizabeth M Dworak1, Aaron J Kaat1
1Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
The Mobile Toolbox (MTB) Word Meaning test shows good reliability and validity for smartphone vocabulary assessment. Further studies are needed for clinical populations.
Area of Science:
- Psychometrics
- Educational Technology
- Cognitive Science
Background:
- Vocabulary assessment is crucial for cognitive and educational evaluations.
- Traditional tests may not be accessible or convenient for all populations.
- Mobile technology offers a platform for accessible and efficient testing.
Purpose of the Study:
- To develop and validate the Mobile Toolbox (MTB) Word Meaning test, a computer adaptive vocabulary measure for smartphones.
- To assess the reliability and validity of the MTB Word Meaning test across multiple studies.
Main Methods:
- The MTB Word Meaning test was designed as a smartphone-optimized, multiple-choice synonym test.
- Items were calibrated with 7,525 participants to create a computer-adaptive algorithm.
- Three studies involving 1,100+ participants assessed self-administration (lab and remote) and external measures.
Main Results:
- The final item bank comprised 1363 words.
- Internal consistency was adequate to good (ρxx = 0.78–0.81).
- Test-retest reliability was good (ICC = 0.65), with moderate to large correlations with similar constructs and small to moderate correlations with age and education.
Conclusions:
- The MTB Word Meaning measure demonstrates reliability and validity for smartphone-based vocabulary assessment.
- The test is suitable for self-administration on personal smartphones.
- Further validation in clinical samples is recommended.
More Related Videos
Related Concept Videos
Binet's Contribution to Measures of Intelligence
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Wechsler's Contribution to Measures of Intelligence
Measurement: Derived Units
Levels of Use of a GIS
Reliability and Validity

