Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.9K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.9K
Self-Evaluation Maintenance Model01:29

Self-Evaluation Maintenance Model

312
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
312
Distribution Reliability and Automation01:25

Distribution Reliability and Automation

514
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
514
Determining the pH of Salt Solutions04:08

Determining the pH of Salt Solutions

48.1K
The pH of a salt solution is determined by its component anions and cations. Salts that contain pH-neutral anions and the hydronium ion-producing cations form a solution with a pH less than 7. For example, in ammonium nitrate (NH4NO3) solution, NO3− ions do not react with water whereas NH4+ ions produce the hydronium ions resulting in the acidic solution.  In contrast, salts that contain pH-neutral cations and the hydroxide ion-producing anions form a solution with a pH greater than 7. For...
48.1K
In Vitro Drug Dissolution: Compendial Testing Models I01:13

In Vitro Drug Dissolution: Compendial Testing Models I

277
Compendial dissolution methods are standardized procedures defined by pharmacopeias to evaluate the rate at which a drug dissolves in a specific medium. These methods ensure batch-to-batch consistency, enable quality control, and support the prediction of drug bioavailability. They are critical for both immediate and modified-release drug products.The apparatuses used for dissolution testing differ in their design and mechanical function, but all aim to simulate the physiological environment of...
277
In Vitro Drug Dissolution: Compendial Testing Models II01:09

In Vitro Drug Dissolution: Compendial Testing Models II

324
Various dissolution methods are utilized to assess a drug’s dissolution rate, including the flow-through cell, paddle-over-disk, cylinder, and reciprocating disk methods.The flow-through cell apparatus (USP (United States Pharmacopeia) method 4) comprises a reservoir for the dissolution medium and a pump that propels the medium through the cell containing the test sample. This method is crucial for assessing modified-release dosage forms with minimally soluble active ingredients,...
324

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Coordinated hand movement sensation revealed through an implanted magnetic prosthetic kinesthetic interface.

Science advances·2026
Same author

Psychosocial outcomes of medical specialty camps for children with physical disabilities.

Journal of pediatric rehabilitation medicine·2026
Same author

Publisher Correction: Editors' Choice 2025.

Communications engineering·2026
Same author

From Sight to Touch: Haptic Sensory Integration Can Facilitate Multi-Limb Coordination.

IEEE transactions on haptics·2026
Same author

Editors' Choice 2025.

Communications engineering·2026
Same author

Different But Complementary Motor Functions Reveal an Asymmetric Recalibration of Upper Limb Bimanual Coordination.

eNeuro·2025

Related Experiment Video

Updated: Feb 2, 2026

A Model to Simulate Clinically Relevant Hypoxia in Humans
09:54

A Model to Simulate Clinically Relevant Hypoxia in Humans

Published on: December 22, 2016

9.4K

Reliability in evaluator-based tests: using simulation-constructed models to determine contextually relevant

Dylan T Beckler1, Zachary C Thumser1, Jonathon S Schofield1

  • 1Laboratory for Bionic Integration, Department of Biomedical Engineering, ND20, Cleveland Clinic, 9500 Euclid Avenue, Cleveland, OH, 44195, USA.

BMC Medical Research Methodology
|November 21, 2018
PubMed
Summary
This summary is machine-generated.

This study developed a new method to interpret inter-evaluator reliability, establishing context-specific thresholds for Krippendorff's alpha to better assess evaluator accuracy and reduce arbitrary cutoffs.

Keywords:
AgreementIndex of reliabilityInter-evaluatorInter-raterIntercoderInterraterKrippendorff’s alphaReliabilityThreshold

More Related Videos

Contextual and Cued Fear Conditioning Test Using a Video Analyzing System in Mice
19:32

Contextual and Cued Fear Conditioning Test Using a Video Analyzing System in Mice

Published on: March 1, 2014

52.8K
Evaluation of a Reliable Biomarker in a Cecal Ligation and Puncture-Induced Mouse Model of Sepsis
05:28

Evaluation of a Reliable Biomarker in a Cecal Ligation and Puncture-Induced Mouse Model of Sepsis

Published on: December 9, 2022

4.4K

Related Experiment Videos

Last Updated: Feb 2, 2026

A Model to Simulate Clinically Relevant Hypoxia in Humans
09:54

A Model to Simulate Clinically Relevant Hypoxia in Humans

Published on: December 22, 2016

9.4K
Contextual and Cued Fear Conditioning Test Using a Video Analyzing System in Mice
19:32

Contextual and Cued Fear Conditioning Test Using a Video Analyzing System in Mice

Published on: March 1, 2014

52.8K
Evaluation of a Reliable Biomarker in a Cecal Ligation and Puncture-Induced Mouse Model of Sepsis
05:28

Evaluation of a Reliable Biomarker in a Cecal Ligation and Puncture-Induced Mouse Model of Sepsis

Published on: December 9, 2022

4.4K

Area of Science:

  • Interdisciplinary research
  • Data analysis
  • Statistical modeling

Background:

  • Inter-evaluator reliability indices are crucial in fields like psychology and medical science.
  • Current interpretation of reliability values often lacks context and relies on arbitrary thresholds.
  • A need exists for methods to meaningfully interpret reliability and establish appropriate thresholds.

Purpose of the Study:

  • To develop a method for relating inter-evaluator agreement to error.
  • To facilitate meaningful interpretation of reliability values and thresholds.
  • To establish context-specific reliability thresholds.

Main Methods:

  • A reference dataset was created from expert human evaluator video analysis.
  • Simulated systematic and random errors were introduced to generate hypothetical evaluators.
  • A mathematical model was developed linking Krippendorff's alpha (agreement) to percent error.

Main Results:

  • A value envelope was established for the worst possible percent error at any given agreement level.
  • Contextually-derived thresholds for Krippendorff's alpha were determined for the specific task.
  • The model successfully identified evaluators with low error and rejected one with high error, despite high overall agreement.

Conclusions:

  • The developed approach provides a less arbitrary method for determining reliability thresholds.
  • Context-specific thresholds are more informative than general "rules of thumb".
  • This procedure can be adapted for various reliability indices and evaluation criteria.