The Effect of Evaluator Training on Inter- and Intrarater Reliability in High-Stakes Assessment in Simulation

Ann E Holland1, Jone Tiffany, Linda Blazovich

  • 1About the Authors Ann E. Holland, PhD, RN, is a professor, Bethel University, St. Paul, Minnesota. Jone Tiffany, DNP, RN, CNE, CHSE, ANEF, is a professor, Bethel University. Linda Blazovich, DNP, RN, CNE, is an associate professor, St. Catherine University, St. Paul, Minnesota. Deborah Bambini, PhD, RN, WHNP-BC, CNE, CHSE, ANEF, is a professor, Grand Valley State University, Grand Rapids, Michigan. Vicki Schug, PhD, RN, CNE, is a professor, St. Catherine University. This study was supported by the National League for Nursing, with funding from Laerdal Medical. The authors acknowledge the work of their research assistant, Dorie Fritz, MSN, RN, and statistician, Joel Frederickson, PhD. For more information, contact Dr. Holland at ann-holland@bethel.edu.

Abstract

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.6K
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.6K
Sources of Self-Esteem II: Performance Feedback01:24

Sources of Self-Esteem II: Performance Feedback

Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem:...
137
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
347