Related Experiment Video
Updated: Jul 15, 2026

10:39
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Validation of Student Wellbeing Teacher-Report Scale (SWTRS) using multilevel factor analysis
1School of Education, University of California, Berkeley.
School Psychology (Washington, D.C.)
|July 13, 2026
Summary
The Student Wellbeing Teacher-Report Scale effectively screens academic, social, and emotional well-being in students. Psychometric analysis confirms its reliability and validity for school-based assessments.
Area of Science:
- Educational Psychology
- Psychometrics
- Child and School Psychology
Background:
- Student subjective well-being is crucial for academic success and mental health.
- School-based screenings require reliable and valid measurement tools.
- The Student Wellbeing Teacher-Report Scale (SWTRS) is a 12-item instrument assessing academic, social, and emotional well-being.
Purpose of the Study:
- To examine the factor structure, validity, and reliability of the SWTRS using a multilevel framework.
- To assess the scale's performance at both individual (within-teacher) and classroom (between-teacher) levels.
- To investigate the associations between SWTRS subscales and internalizing/externalizing behaviors.
Main Methods:
- Multilevel confirmatory factor analysis (MCFA) was conducted on data from 81 teachers and 1,910 students.
- Cross-level metric invariance was tested to evaluate measurement equivalence across levels.
- Multilevel structural equation modeling (MSEM) was used to examine relationships with behavioral outcomes.
Main Results:
- MCFA supported a three-factor correlated model with one social well-being item removed.
- Cross-level metric invariance was established, indicating similar conceptualization of well-being across levels.
- SWTRS subscales showed unique associations with internalizing and externalizing behaviors at the within-teacher level; social well-being linked to externalizing behaviors at the between-teacher level.
- Multilevel reliability coefficients (α and ω) ranged from .81 to .95, indicating satisfactory internal consistency.
Conclusions:
- The SWTRS, with a modified item, demonstrates strong psychometric support for use as a school-based screener.
- Findings highlight the scale's utility in assessing student well-being at multiple levels.
- Further research and practical application are encouraged, acknowledging potential limitations due to sample size.
Related Concept Videos
Factorial Design
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
One-Way ANOVA: Unequal Sample Sizes
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...