Related Experiment Video
Updated: Sep 26, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Evaluation of Large Language Models as Tools, Models, and Partners in Creative Thinking Research: A Selective
Kexin Huang1,2, Chunlei Liu1, Jiaqin Yang1
1School of Psychology, Qufu Normal University, Qufu 273165, China.
Abstract:
Creativity research faces three persistent bottlenecks: divergent-thinking scoring is labour-intensive, cognitive models of creativity remain underspecified, and laboratory tasks fall short of real-world creative achievement. Large language models (LLMs) offer potential solutions, but the field lacks a structured framework for evaluating them. This selective narrative review (January 2018-June 2026) applies the generation-capability-assessment (GCA) framework, whose three axes are operationalised through descriptive criteria with provisional heuristic thresholds. On the generation axis, LLMs exceed average human performance on divergent-thinking tasks in most independent comparisons (Hedges' g ≈ 0.5-2.6), an advantage qualified by fluency dependency, the superiority of top-performing humans at scale, and a novelty-typicality trade-off. On the capability axis, LLMs simulate some task-level associative behaviour and can generate hypotheses for human research, but there is no evidence that they instantiate human-like creative mechanisms. On the assessment axis, automated scoring shows promising reliability and convergent validity for specific languages and tasks (ICC ≥ 0.80 and r ≥ 0.70 in selected studies), but cross-language generalisation is largely untested and individual-level use is unsupported. Human-AI co-creativity may benefit from a division of labour, although social-affective dimensions may matter more than cognitive support. We provide a GCA reporting protocol and identify research priorities.
Related Concept Videos
Language and Cognition
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Components of Language
Creative Thinking
Divergent thinking is the...
Cognitivism
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process information is...
Models, Theories, and Laws