Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A web-based program for coding open-ended response protocols.

S L Ames1, P E Gallaher, P Sun

  • 1University of California, Los Angeles, California and University of Southern California, Los Angeles, California, USA. sames@usc.edu

Behavior Research Methods
|January 13, 2006
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

[Analysis of the chronic health hazards of occupational exposure to fluorine and its inorganic compounds].

Zhonghua lao dong wei sheng zhi ye bing za zhi = Zhonghua laodong weisheng zhiyebing zazhi = Chinese journal of industrial hygiene and occupational diseases·2026
Same author

[Advances in breast cancer tumor-infiltrating lymphocytes evaluation and deep learning applications].

Zhonghua bing li xue za zhi = Chinese journal of pathology·2025
Same author

Potential molecular targets and pathways of a traditional Chinese medicine formula for bovine endometritis identified by network pharmacology.

Polish journal of veterinary sciences·2024
Same author

[circ_BACH2 affects the malignant biological behavior of papillary thyroid cancer by regulating miR-370-3p].

Zhonghua zhong liu za zhi [Chinese journal of oncology]·2024
Same author

[Solasonine promotes apoptosis of non-small cell lung cancer cells by regulating the Bcl-2/Bax/caspase-3 pathway].

Nan fang yi ke da xue xue bao = Journal of Southern Medical University·2024
Same author

Coherent control of an optical tweezer phonon laser.

Optics express·2024
Same journal

Planned missingness in intensive longitudinal studies: Extensions and comparisons of multiform designs.

Behavior research methods·2026
Same journal

A validity-guided workflow for robust large language model research in psychology.

Behavior research methods·2026
Same journal

Are 7-point Likert scales preferable to 5-point scales in language research?

Behavior research methods·2026
Same journal

Generative psychometrics via AI-GENIE: Automatic item generation and validation with network-integrated evaluation.

Behavior research methods·2026
Same journal

Exploring psychological tradeoffs: Developing and demonstrating an R Shiny app for Pareto optimization.

Behavior research methods·2026
Same journal

The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling.

Behavior research methods·2026
See all related articles

A new web-based application enhances the efficiency and reliability of coding open-ended assessment responses. This tool systematically manages multiple coders, tracks progress, and ensures data quality for research.

Area of Science:

  • Psychology
  • Educational Technology
  • Data Science

Background:

  • Coding open-ended assessment responses is often time-consuming and prone to inconsistency.
  • Existing methods for evaluating coder reliability can be inefficient and lack systematic oversight.
  • There is a need for robust tools to manage and validate the coding of qualitative data.

Purpose of the Study:

  • To develop and evaluate a web-based application designed to improve the efficiency and reliability of coding open-ended assessment responses.
  • To provide a systematic method for multiple raters to categorize and evaluate qualitative data.
  • To assess the statistical reliability and feasibility of using this application for open-ended data analysis.

Main Methods:

  • Development of a web-based application for systematic response categorization by multiple raters.

Related Experiment Videos

  • Implementation of features for tracking coder progress and assessing interrater consistency.
  • Evaluation of the application's efficacy using data from two empirical studies involving free and controlled association tasks.

    • Main Results:

    • The application demonstrated substantial interrater agreement across various categories and tasks.
    • The system effectively managed multiple coders, tracked responses, and identified areas needing further training.
    • The results confirmed the application's feasibility and reliability in coding open-ended data.

    Conclusions:

    • The developed web-based coding application offers a feasible and reliable method for managing and analyzing open-ended assessment data.
    • The tool significantly improves coding efficiency and enhances the systematic evaluation of coder performance.
    • This application provides a valuable resource for researchers seeking to improve the quality and manageability of qualitative data coding.