Related Experiment Video
Updated: Mar 25, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
The validity and reliability of the EValuation of INtervention Scale: preliminary report
Inga Warren1, Beverley Hicks1, Agneta Kleberg2
1Therapy Services, Imperial Neonatal Service, Imperial College Healthcare NHS Trust, London, UK.
Insights
The EValuation of INtervention Scale (EVIN) effectively measures non-pharmacological pain management for neonates. This validated scale ensures reliable assessment of interventions for reducing infant pain and stress during procedures.
Area of Science:
- Neonatal care
- Pain management
- Evidence-based practice
Background:
- Neonatal infants experience significant pain and stress during medical procedures.
- Effective pain management is crucial to prevent adverse short- and long-term outcomes.
- Non-pharmacological strategies are recommended for neonatal pain and stress reduction.
Purpose of the Study:
- To validate the content of the EValuation of INtervention Scale (EVIN).
- To test the reliability of the EVIN for evaluating non-pharmacological interventions.
- To assess the suitability of EVIN in neonatal care settings.
Main Methods:
- Content validation involved 80 multidisciplinary participants.
- Inter-rater reliability was tested on preterm infants (N=12) during interventions.
- The revised scale was assessed during invasive (N=16) and noninvasive (N=18) procedures using intraclass correlation coefficients (ICC).
Main Results:
- High intraclass correlation coefficients (ICC) were achieved for both invasive (0.962) and noninvasive (0.970) procedures.
- The results demonstrate excellent inter-rater reliability for the EVIN.
- The scale showed strong consistency in evaluating interventions.
Conclusions:
- The EValuation of INtervention Scale (EVIN) is a reliable tool.
- EVIN is suitable for evaluating non-pharmacological support during painful neonatal procedures.
- The scale supports evidence-based pain management in neonatal intensive care units.
Aim:
Pain management is a priority for infants receiving neonatal care as they undergo many necessary painful and stressful interventions, which are associated with negative short- or long-term consequences. This study aims to validate the content, and test the reliability, of the EValuation of INtervention Scale (EVIN), which is designed to evaluate the use of widely recommended nonpharmacological strategies to reduce neonatal pain and stress during procedures.
Methods:
The content of the EVIN was validated with multidisciplinary participation (N = 80), and consistency was established via observations on preterm infants (N = 12, at 31-34 weeks' gestation) during interventions in a neonatal unit. A revised scale was tested for inter-rater reliability with observations of invasive (blood sampling, N = 16) and noninvasive (nappy change, N = 18) interventions. The intraclass correlation coefficient (ICC) was used to determine inter-rater reliability. SPSS (PASW Statistics) version 18 was used for analysis.
Results:
Very good intraclass correlation coefficients (>0.8) for both invasive (0.962) and noninvasive procedures (0.970) were achieved.
Conclusion:
These results indicate that the EVIN is suitable for the evaluation of nonpharmacological support during painful or stressful interventions.
Related Concept Videos
Reliability and Validity
Self-Report Tests of Personality
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Nursing Evaluation
Self-Evaluation Maintenance Model
Data Validation
Key parameters for method validation include:

