Jove
Visualize
Contact Us

Related Experiment Videos

Evaluation of educational software.

Titus K L Schleyer1, Lynn A Johnson

  • 1Center for Dental Informatics, School of Dental Medicine, University of Pittsburgh, PA 15261, USA. titus@pitt.edu

Journal of Dental Education
|December 3, 2003
PubMed
Summary

Evaluating educational software is challenging but crucial. Rigorous evaluation requires careful consideration of outcomes, study design, and complementary objectivist and subjectivist methods for comprehensive assessment.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Multistate Model of Chronic Wounds, Amputations, and Mortality: Cohort Study of a State-wide Registry.

Annals of surgery·2025
Same author

A statewide system for maternal-infant linked longitudinal surveillance: Indiana's model for improving maternal and child health.

International journal of population data science·2025
Same author

NCCN guideline concordance in colon and rectal cancer patients within a comprehensive health system.

American journal of surgery·2024
Same author

Cardiovascular disease in thymic cancer patients.

Frontiers in cardiovascular medicine·2024
Same author

A patient-centered nurse-supported primary care-based collaborative care program to treat opioid use disorder and depression: Design and protocol for the MI-CARE randomized controlled trial.

Contemporary clinical trials·2023
Same author

Preliminary evaluation of the <i>Chest Pain Dashboard</i>, a FHIR-based approach for integrating health information exchange information directly into the clinical workflow.

AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science·2019
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Area of Science:

  • Educational Technology
  • Learning Sciences
  • Software Evaluation

Background:

  • Effective educational software development necessitates robust evaluation.
  • Current evaluation methods face challenges in defining outcomes, managing media effects, and practical study design.
  • Confounding variables, small effect sizes, contamination, and ethical considerations complicate rigorous evaluation.

Purpose of the Study:

  • To explore the complexities and challenges in evaluating educational software.
  • To present and illustrate diverse evaluation methodologies, including objectivist and subjectivist approaches.
  • To encourage the adoption of comprehensive evaluation designs for educational interventions.

Main Methods:

  • Discussion of objectivist evaluation focusing on quantitative measures and instrument validity/reliability.
  • Exploration of subjectivist evaluation employing qualitative insights.
  • Analysis of common but problematic comparative methods (e.g., test performance) and their limitations.

Main Results:

  • Educational outcome measurement is complex, with test performance often being an insufficient indicator of competence.
  • Objectivist and subjectivist approaches offer complementary perspectives on the impact of educational software.
  • Measurement studies assessing instrument reliability and validity are essential precursors to objectivist demonstration studies.

Conclusions:

  • Meaningful evaluation of educational software requires addressing inherent methodological and practical difficulties.
  • Integrating both objectivist and subjectivist evaluation strategies provides a more holistic understanding of software efficacy.
  • Researchers should consider a broad spectrum of evaluation designs to answer complex questions about educational technology.

Related Experiment Videos