Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Cochran's Q Test01:17

Cochran's Q Test

353
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
353
Qualitative Analysis03:46

Qualitative Analysis

22.4K
For solutions containing mixtures of different cations, the identity of each cation can be determined by qualitative analysis. This technique involves a series of selective precipitations with different chemical reagents, each reaction producing a characteristic precipitate for a specific group of cations. Metal ions within a group are further separated by varying the pH, heating the mixture to redissolve a precipitate, or adding other reagents to form complex ions.
For instance, group IV...
22.4K
Reaction Quotient02:35

Reaction Quotient

48.6K
The status of a reversible reaction is conveniently assessed by evaluating its reaction quotient (Q). For a reversible reaction described by m A + n B ⇌ x C + y D, the reaction quotient is derived directly from the stoichiometry of the balanced equation as
48.6K
Goodness-of-Fit Test01:16

Goodness-of-Fit Test

3.4K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.4K
Response Surface Methodology01:16

Response Surface Methodology

140
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
140
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Your media diet is impacting your actual diet: The effects of influencer "What I Eat in a Day" YouTube videos on influencer perceptions and nutrition behaviors.

Digital health·2026
Same author

Justice denied: reproductive injustices facing Black Queer birthing people in the U.S. healthcare system.

Reproductive health·2026
Same author

Social Media Screening: Racial Disparities in Pap Smear Content on TikTok.

Health promotion practice·2026
Same author

Drug Development.

Alzheimer's & dementia : the journal of the Alzheimer's Association·2025
Same author

Rural dwelling as a risk factor for mental health and well-being for LGBTQ+ youth: The mechanism of social support.

The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association·2025
Same author

Hot or Not? Implicit and Explicit Attitudes of Sexualized Profiles on Tinder.

Cyberpsychology, behavior and social networking·2025
Same journal

Towards a unified approach to formal "risk of bias" assessments for causal and descriptive inference.

Quality & quantity·2026
Same journal

Unraveling honest responding: a systematic review on the effectiveness of social desirability bias reduction methods in survey research.

Quality & quantity·2026
Same journal

Unlocking insights: assessing the quality of conventional and image-based responses on books at home in an online mobile survey.

Quality & quantity·2026
Same journal

An Ounce of Prevention: Using Conversational Interviewing and Avoiding Agreement Response Scales to Prevent Acquiescence.

Quality & quantity·2026
Same journal

It's a long way to the top (if you wanna biplot): a back-to-basics perspective on the implementation of principal component biplots in R.

Quality & quantity·2026
Same journal

Gender bias in machine learning: insights from official labour statistics and textual analysis.

Quality & quantity·2026
See all related articles

Related Experiment Video

Updated: Jul 9, 2025

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE
06:57

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE

Published on: May 14, 2019

10.5K

Evaluating and Tracking Qualitative Content Coder Performance Using Item Response Theory.

Michael Hennessy1, Amy Bleakley1, Morgan E Ellithorpe1

  • 1University of Delaware, Department of Communication, 250 Pearson Hall, Newark, DE 19716.

Quality & Quantity
|December 4, 2023
PubMed
Summary
This summary is machine-generated.

Item Response Theory (IRT) offers a new way to track individual coder performance in media content analysis, providing insights beyond traditional agreement measures. This method enhances the reliability of content coding by detailing coder consistency over time.

Keywords:
coder agreementcontent analysisitem response theory

More Related Videos

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
06:43

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

16.1K
Making Sense of Listening: The IMAP Test Battery
11:25

Making Sense of Listening: The IMAP Test Battery

Published on: October 11, 2010

15.8K

Related Experiment Videos

Last Updated: Jul 9, 2025

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE
06:57

Modeling Verbal Behavior Deficits with the Stimulus Control Ratio Equation, SCoRE

Published on: May 14, 2019

10.5K
The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
06:43

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

16.1K
Making Sense of Listening: The IMAP Test Battery
11:25

Making Sense of Listening: The IMAP Test Battery

Published on: October 11, 2010

15.8K

Area of Science:

  • Communication Studies
  • Media Research
  • Quantitative Psychology

Background:

  • Content analysis is crucial for understanding media content, exposure, and effects across traditional and social media platforms.
  • Traditional reliability measures like Kappa-like statistics aggregate coder decisions, masking individual coder performance and consistency.
  • Accurate assessment of individual coder reliability is essential for the validity of content analysis findings.

Purpose of the Study:

  • To introduce and evaluate Item Response Theory (IRT) as a novel methodology for assessing individual coder performance in content analysis.
  • To demonstrate IRT's capability in tracking coder consistency over time and across different coded items.
  • To provide a coder-specific alternative to aggregated reliability measures in media content analysis.

Main Methods:

  • Utilized a dataset comprising 105 advertisements for sports and energy drinks.
  • Employed five human coders to perform qualitative content coding on the selected media items.
  • Applied Item Response Theory (IRT) models to analyze the coded data and assess individual coder performance.

Main Results:

  • Item Response Theory (IRT) successfully tracked the performance of individual coders over the duration of the study.
  • IRT provided specific insights into the consistency of each coder's decisions on qualitatively coded objects.
  • The results indicated that IRT offers a more granular understanding of coder reliability compared to aggregate measures.

Conclusions:

  • Item Response Theory (IRT) is a valuable addition to the methodological toolkit for content analysts.
  • IRT enables precise measurement and tracking of individual content coder performance and decision consistency.
  • Adoption of IRT can enhance the rigor and transparency of reliability assessments in media content analysis.