Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

What is behind a summary-evaluation decision?

Iraide Zipitria1, Pedro Larrañaga, Ruben Armañanzas

  • 1Department of Social Psychology and Behavioral Science Methodology, University of the Basque Country, Donostia, Spain. iraide.zipitria@ehu.es

Behavior Research Methods
|June 5, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Derivation of an intrinsic brain activity biomarker for the earliest prediction of cognitive decline.

Scientific reports·2026
Same author

RNACOREX - RNA coregulatory network explorer and classifier.

PLoS computational biology·2025
Same author

Conformal inference for reliable single cell RNA-seq annotation.

Bioinformatics (Oxford, England)·2025
Same author

Discovering Genetic Variants in Hypertrophic Cardiomyopathy With Multiple Machine Learning Techniques.

IEEE transactions on computational biology and bioinformatics·2025
Same author

KLRB1 expression in nasopharyngeal mucosa as a prognostic biomarker in COVID-19 patients.

Scientific reports·2025
Same author

BN-BacArena: Bayesian network extension of BacArena for the dynamic simulation of microbial communities.

Bioinformatics (Oxford, England)·2024
Same journal

Planned missingness in intensive longitudinal studies: Extensions and comparisons of multiform designs.

Behavior research methods·2026
Same journal

A validity-guided workflow for robust large language model research in psychology.

Behavior research methods·2026
Same journal

Are 7-point Likert scales preferable to 5-point scales in language research?

Behavior research methods·2026
Same journal

Generative psychometrics via AI-GENIE: Automatic item generation and validation with network-integrated evaluation.

Behavior research methods·2026
Same journal

Exploring psychological tradeoffs: Developing and demonstrating an R Shiny app for Pareto optimization.

Behavior research methods·2026
Same journal

The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling.

Behavior research methods·2026
See all related articles

Human summary grading is complex and difficult to quantify objectively. This study analyzed expert grading decisions using Bayesian networks to understand the underlying factors in text comprehension assessment.

Area of Science:

  • Psychology
  • Computational Linguistics
  • Artificial Intelligence

Background:

  • Summary evaluation is a key method for assessing text comprehension and topic understanding.
  • Objective quantification of human summary grading remains a challenge.
  • Understanding grading behavior is crucial for developing reliable assessment tools.

Purpose of the Study:

  • To empirically analyze the decision-making processes of human experts when grading summaries.
  • To model summary evaluation behavior within a computational framework.
  • To identify factors influencing the objectivity of summary grading.

Main Methods:

  • Expert evaluation of summaries generated in critical summarization development contexts.
  • Modeling of grading data using Bayesian networks.

Related Experiment Videos

  • Utilizing the Elvira application for graphical analysis of variable predictive power.

    • Main Results:

    • The study provides insights into the complex decision-making involved in human summary grading.
    • Bayesian network modeling revealed patterns in expert evaluation behavior.
    • The computational framework facilitated the analysis of factors influencing grading objectivity.

    Conclusions:

    • Analyzing summary-evaluation decision-making computationally can enhance the objectivity of text comprehension assessment.
    • Understanding human grading behavior is essential for developing more reliable automated summarization evaluation systems.
    • This research contributes to bridging the gap between subjective human judgment and objective assessment in natural language processing.