Related Experiment Video
Updated: Feb 4, 2026
08:12
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
3.0K
Beyond subjective judgments: Predicting evaluations of creative writing from computational linguistic features
Claire M Zedelius1, Caitlin Mills2, Jonathan W Schooler3
1University of California, Santa Barbara, CA, USA. claire.zedelius@gmail.com.
Behavior Research Methods
|September 29, 2018
Summary
Evaluating creative writing is possible. Human creativity assessments of short stories can be predicted by established creativity measures and computerized linguistic analysis, showing objective evaluation is feasible.
Area of Science:
- Psychology
- Computational Linguistics
- Creative Writing Studies
Background:
- Assessing creativity in writing is challenging due to its subjective nature.
- Systematic evaluation methods for creative writing are needed.
- Existing creativity measures and linguistic analysis offer potential avenues for objective assessment.
Purpose of the Study:
- To determine if human evaluations of creative writing can be predicted by established creativity measures.
- To investigate if computerized linguistic analyses of short stories can predict human creativity ratings.
- To validate a rubric for assessing creativity in written narratives.
Main Methods:
- Two studies were conducted where college students wrote short stories.
- Stories were evaluated by raters using a rubric with high interrater reliability.
- Linguistic features were analyzed using Coh-Metrix and Linguistic Inquiry and Word Count (LIWC).
- Correlations were examined between rubric evaluations, established creativity measures (divergent thinking, associative fluency), and linguistic features.
Main Results:
- Rubric evaluations demonstrated convergent validity, correlating with established creativity measures.
- Linguistic features of the stories significantly predicted human ratings of creativity.
- Computerized text analysis successfully captured objective features related to writing creativity.
Conclusions:
- Creative writing can be reliably and systematically evaluated.
- Objective features of text, identifiable through linguistic analysis, contribute to perceived creativity.
- The developed evaluation rubric is a validated tool for assessing creative writing.
Related Concept Videos
01:25Creative Thinking
1.3K
Creative thinking encompasses innovative and unconventional methods for addressing challenges, often leading to groundbreaking solutions. Instead of focusing solely on enhancing existing systems, such as increasing smartphone battery capacity, creative thinking might inspire advancements like energy-efficient batteries or processors that minimize power consumption. This multidimensional approach underscores the importance of exploring novel pathways to innovation.
Divergent thinking is the...
Divergent thinking is the...
1.3K
01:30Irritable Bowel Syndrome II: Clinical Features and Diagnostic Evaluation
790
Irritable Bowel Syndrome II: Clinical Features and Diagnostic Evaluation
Irritable Bowel Syndrome (IBS) is classified into subtypes based on the predominant bowel habits as determined by the Bristol Stool Form Scale (BSFS). The subtypes are:
Irritable Bowel Syndrome (IBS) is classified into subtypes based on the predominant bowel habits as determined by the Bristol Stool Form Scale (BSFS). The subtypes are:
790
01:11Guidelines for Writing Outcome
4.0K
When developing expected outcomes for a patient care plan, the nurse should adhere to the following recommendations:
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
4.0K
02:27Predicting Molecular Geometry
45.9K
VSEPR Theory for Determination of Electron Pair Geometries
45.9K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.8K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.8K
01:03Prediction Intervals
3.4K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.4K