Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Using a sampling strategy to address psychometric challenges in tutorial-based assessments.

Kevin W Eva1, Patty Solomon, Alan J Neville

  • 1Department of Clinical Epidemiology and Biostatistics, Program for Educational Research and Development, MDCL 3510, McMaster University, L8N 3Z5, Hamilton, ON, Canada. evakw@mcmaster.ca

Advances in Health Sciences Education : Theory and Practice
|November 2, 2006
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

With great power comes great responsibility: How narrow conceptions of validity in high-stakes testing undermine competence.

Medical education·2026
Same author

How Did You Get There? The Value of Segues for Illustrating Your Logic.

Perspectives on medical education·2026
Same author

Consistency and inconsistency with which sociodemographic variables are associated with performance on medical school selection tools.

Medical teacher·2026
Same author

It is the Unknown That Matters: Program Directors' Perspectives on Information Gaps in Learner Educational Handovers.

Academic medicine : journal of the Association of American Medical Colleges·2026
Same author

The impact of GenAI on applicant behaviour, performance, and interview reliability during virtual interviews for medical school admissions.

NPJ digital medicine·2025
Same author

How can I help at this moment? Outlining three generations of coaching for health professions educators.

Medical education·2025
Same journal

Historicizing health professions education research: history as a strategic analytic resource.

Advances in health sciences education : theory and practice·2026
Same journal

Factors influencing workplace collaboration and learning between resident doctors and senior nurses: a scoping review.

Advances in health sciences education : theory and practice·2026
Same journal

Grave lessons: a guide to historiographical research in health professions education.

Advances in health sciences education : theory and practice·2026
Same journal

A scoping review of inquiry in medicine and nursing using Dewey's perspective.

Advances in health sciences education : theory and practice·2026
Same journal

"Teaching is important, but it's not important": a qualitative study of teacher identity among early-career academics in health professions.

Advances in health sciences education : theory and practice·2026
Same journal

The Moral Competence Test in healthcare education: a critique based on informal logic.

Advances in health sciences education : theory and practice·2026
See all related articles

A simple, frequently used tutorial assessment tool with minimal observations demonstrates good psychometric properties. This approach to evaluating student performance in small group learning settings is effective and reliable.

Area of Science:

  • Medical Education
  • Educational Psychology
  • Assessment Methods

Background:

  • Tutorial-based assessment aligns with small group learning philosophies but presents challenges for educators.
  • Developing reliable and valid assessment tools for this context is crucial.

Purpose of the Study:

  • To evaluate the psychometric characteristics of a tutorial-based assessment tool.
  • To determine the reliability and validity of a simplified evaluation method using minimal observations.

Main Methods:

  • A 3-item evaluation form assessing professional behavior, contribution to group process, and content was developed.
  • Tutors (N=169) used the 10-point scale form after each tutorial over an academic unit.
  • Psychometric properties including internal consistency and test-retest reliability were analyzed.

Related Experiment Videos

Main Results:

  • The assessment tool showed appropriate internal consistency across five programs.
  • While single ratings had low reliability, average ratings achieved a reliability of at least 0.75.
  • Construct validity was supported by increasing ratings over time and higher scores for senior students.

Conclusions:

  • A "minimal observations often" approach to tutorial-based assessment exhibits favorable psychometric characteristics.
  • This method appears more effective than comprehensive tools for assessing tutorial performance.
  • Context specificity supports the efficacy of frequent, brief assessments in educational settings.