Related Experiment Video
Updated: Jun 14, 2025

Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
Concurrent validity, test-retest reliability, and normative properties of the ignite app: A cognitive assessment for
Rhian S Convery1, Kerala Adams-Carr1, Jennifer M Nicholas2
1Department of Neurodegenerative Diseases, Dementia Research Centre, Institute of Neurology, University College London.
Objective:
Digital biomarkers can provide frequent, real-time monitoring of health-related behavior and could play an important role in the assessment of cognition in frontotemporal dementia (FTD). However, the validity and reliability of digital biomarkers as measures of cognitive function must first be determined.
Method:
The Ignite cognitive app contains iPad-based measures of executive function, social cognition, and other domains affected in FTD. Here we describe the normative properties of the Ignite tests, evaluate associations with gold-standard neuropsychological tests, and investigate test-retest reliability through two healthy control studies. Over 2,000 cognitively normal adults aged 20-80 years were recruited to complete the Ignite app remotely. A separate cohort of 98 healthy controls completed Ignite at two timepoints (7 days apart), a pen and paper neuropsychology battery, and a User Experience Questionnaire.
Results:
Significant associations were found between age and performance on several Ignite measures of processing speed (r = 0.42-0.56, p < .001) and executive function (r = 0.43-0.62, p < .001). With the exception of one test (Time Tap), the Ignite tests demonstrated moderate to excellent test-retest reliability (intraclass correlation coefficients [ICC] = 0.54-0.92) and significant correlations with their pen and paper counterparts (r = 0.25-0.72, p < .05). The majority of participants (> 90%) rated the app favorably, stating it was enjoyable and easy to complete unsupervised.
Conclusions:
These findings offer early support for the validity of the Ignite tests suggesting they measure the intended cognitive processes, capture a stable picture of performance over time, and are well accepted in healthy controls. This work supports the feasibility of administering the app remotely and its potential utility as a cognitive tool in FTD; however, validation is ongoing, and further work is required before Ignite can be used as an endpoint in clinical trials. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
Related Concept Videos
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Reliability and Validity
Cognitive Development During Adulthood
Dementia
The progression of dementia is generally gradual....
Wechsler's Contribution to Measures of Intelligence
Self-Report Tests of Personality

