Related Experiment Video
Updated: Jul 19, 2025

Author Spotlight: Self-Assessment Protocol for Predicting Psoriatic Arthritis in Psoriasis Patients
Published on: March 1, 2024
The Multilevel Reliability and Interrater Agreement of the Nurse Practitioner Primary Care Organizational Climate
Jianfang Liu1, Affan Ghaffari2, Grant R Martsolf3
1Columbia University Irving Medical Center, New York, NY, USA jl4029@cumc.columbia.edu.
Abstract:
Background and Purpose: It is critical to accurately measure and understand the nurse practitioner (NP) work environment in which individual NP information is gathered but decisions or inferences are made at an aggregated, group level. However, there is little research on preconditions of aggregating individual-level data into group level in nursing research. This study was conducted to assess the multilevel reliability and group interrater agreement (IRA) of the Nurse Practitioner Primary Care Organizational Climate Questionnaire. Methods: Secondary data analysis from a cross-sectional survey with 247 NPs in 112 practices across 6 U.S. states in 2018-2019 was used. Results: The generalizability coefficients and values of IRA were acceptable (> .70), and values of ICC(1) were significant (.18-.38). Conclusions: Aggregating individual NP data to a higher group-level work environment construct is acceptable.
Related Concept Videos
Levels of Communication I: Intrapersonal, Interpersonal, and Small Group
We can participate in these relationships through verbal, nonverbal, and mediated communication. We engage in verbal communication when we use words during our interaction to convey specific meanings. On the other hand, nonverbal communication refers to various factors that can impact how we understand each other—for example, facial expressions.
We interact with others using mediated technologies like the...
Accountability and Responsibility of a Nurse II
For example, a nurse demonstrating respect and compassion might listen attentively to a patient's concerns, provide...
Nurses' Legal Responsibilities II
Communication between nurses and...
Accountability and Responsibility of a Nurse I
Nursing Evaluation
Obedience

