Related Experiment Video
Updated: Sep 30, 2025
10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
18.6K
Alberta Rating Index for Apps: Study of Reliability and Validity
Summary
Occupational therapists now have a reliable tool to assess mobile health app quality. The Alberta Rating Index for Apps (ARIA) demonstrates strong reliability, aiding in selecting effective digital health solutions.
Area of Science:
- Digital health
- Occupational therapy
- Health informatics
Background:
- The proliferation of mobile health applications necessitates a standardized method for quality assessment.
- Existing tools lack comprehensive evaluation criteria for occupational therapists and clients.
- There is a critical need for a reliable rating system for health apps.
Purpose of the Study:
- To develop and validate the Alberta Rating Index for Apps (ARIA).
- To provide occupational therapists with a dependable tool for evaluating mobile health applications.
- To enhance the selection process of digital health interventions.
Main Methods:
- A sequential, three-phase design was employed for the development of the ARIA.
- The reliability and validity of the ARIA were assessed with 10 participants.
- The study involved user groups including occupational therapists, older adults, and adults with mental health conditions.
Main Results:
- ARIA achieved high inter-rater reliability coefficients: 0.95 for occupational therapists, 0.60 for older adults, and 0.88 for adults with mental health conditions.
- The correlation between ARIA and the U-MARS scale was low to moderate, indicating unique contributions.
- ARIA demonstrated comprehensive criteria, including privacy and security, not covered by U-MARS.
Conclusions:
- ARIA exhibits strong inter-rater reliability across key user groups, particularly for occupational therapists.
- The Alberta Rating Index for Apps offers a more comprehensive evaluation of mobile health applications compared to existing scales.
- Further research with diverse populations and health apps is recommended to broaden ARIA's applicability.
Related Concept Videos
01:29Reliability and Validity
13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
01:29Measures of Intelligence
7.9K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.9K
01:22Self-Report Tests of Personality
487
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
487
01:02Ranks
296
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
296
01:13Accuracy and Errors in Hypothesis Testing
361
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
361
01:21Wilcoxon Rank-Sum Test
371
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
371