Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Improving Translational Accuracy02:07

Improving Translational Accuracy

3.8K
3.8K
Improving Translational Accuracy02:07

Improving Translational Accuracy

15.6K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
15.6K
Reliability and Validity01:29

Reliability and Validity

14.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Prejudice against jagged personality profiles: Rethinking bias in psychological research and clinical practice.

Current opinion in psychology·2026
Same author

Enhancing curiosity with a wise intervention to improve political conversations and relationships.

Scientific reports·2025
Same author

Spanish adaptation of the multidimensional workplace curiosity scale.

Acta psychologica·2025
Same author

Past glories feel good but creative minorities push us forward.

The Behavioral and brain sciences·2025
Same author

The costs of curiosity and creativity: Minimizing the downsides while maximizing the upsides.

The Behavioral and brain sciences·2024
Same author

Swimming with a head-mounted display: dual-task costs.

Ergonomics·2024

Related Experiment Video

Updated: Apr 10, 2026

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
12:50

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

41.0K

Grant Peer Review: Improving Inter-Rater Reliability with Training.

David N Sattler1, Patrick E McKnight2, Linda Naney3

  • 1Department of Psychology, Western Washington University, Bellingham, Washington, United States of America.

Plos One
|June 16, 2015
PubMed
Summary

Grant reviewer training significantly improved scoring accuracy and reliability for both novice and experienced reviewers. Specialized training is crucial for accurate research funding decisions.

More Related Videos

Using Clicker Training and Social Observation to Teach Rats to Voluntarily Change Cages
08:01

Using Clicker Training and Social Observation to Teach Rats to Voluntarily Change Cages

Published on: October 25, 2018

11.0K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

8.0K

Related Experiment Videos

Last Updated: Apr 10, 2026

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
12:50

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

41.0K
Using Clicker Training and Social Observation to Teach Rats to Voluntarily Change Cages
08:01

Using Clicker Training and Social Observation to Teach Rats to Voluntarily Change Cages

Published on: October 25, 2018

11.0K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

8.0K

Area of Science:

  • Public Health
  • Research Administration
  • Scientific Peer Review

Background:

  • Grant review is critical for research funding allocation.
  • Inconsistent scoring and lack of understanding of criteria can impact funding decisions.
  • Existing reviewer training may be insufficient, particularly for experienced reviewers.

Purpose of the Study:

  • To develop and evaluate a brief training program for grant reviewers.
  • To assess the program's impact on inter-rater reliability, rating scale knowledge, and reviewer effort.
  • To enhance the reliability and accuracy of research grant proposal scoring.

Main Methods:

  • Seventy-five Public Health professors participated in the study.
  • Participants were divided into training (video) and no-training groups.
  • Reviewers scored National Institutes of Health (NIH) criteria-based proposal summaries.

Main Results:

  • The training video significantly increased scoring accuracy for all participants.
  • Inter-rater reliability improved for both novice and experienced reviewers post-training.
  • Reviewers in the training group spent more time reading the review criteria.

Conclusions:

  • Brief, specialized training enhances grant reviewer performance.
  • Even experienced reviewers benefit from and may overestimate their understanding of rating scales.
  • Implementing standardized reviewer training is essential for improving research grant evaluations.