Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Language and Cognition01:27

Language and Cognition

340
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
340
Improving Translational Accuracy02:07

Improving Translational Accuracy

2.5K
2.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A reporting checklist for large language models in behavioural science.

Nature human behaviour·2026
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

One test, many tongues: Surveying language proficiency across the globe.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Estimating the effect size of moral contagion in online networks: A pre-registered replication and meta-analysis.

PNAS nexus·2025
Same author

Characterizing the Large-Scale Structure of Multimodal Semantic Networks.

Cognitive science·2025
Same author

Using LLMs to advance the cognitive science of collectives.

Nature computational science·2025

Related Experiment Video

Updated: Jun 17, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

533

GPT is an effective tool for multilingual psychological text analysis.

Steve Rathje1, Dan-Mircea Mirea2, Ilia Sucholutsky3

  • 1Department of Psychology, New York University, New York, NY 10003.

Proceedings of the National Academy of Sciences of the United States of America
|August 12, 2024
PubMed
Summary

Large-language models like GPT offer a powerful, accessible tool for automated psychological text analysis across multiple languages. These models demonstrate superior accuracy compared to traditional methods, democratizing advanced natural language processing for research.

Keywords:
AIGPTlarge language modelsmachine learningtext analysis

More Related Videos

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.2K
Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning
05:33

Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning

Published on: January 29, 2020

6.0K

Related Experiment Videos

Last Updated: Jun 17, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

533
Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.2K
Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning
05:33

Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning

Published on: January 29, 2020

6.0K

Area of Science:

  • Social and behavioral sciences
  • Computational linguistics
  • Psychological science

Background:

  • Automated text analysis is increasingly used in social and behavioral sciences to measure psychological constructs.
  • Existing methods often lack cross-linguistic capabilities and require significant expertise.

Purpose of the Study:

  • To evaluate the efficacy of Generative Pre-trained Transformer (GPT) models for automated psychological text analysis in multiple languages.
  • To compare GPT's performance against traditional dictionary-based methods and fine-tuned machine learning models.

Main Methods:

  • Utilized 15 datasets comprising 47,925 annotated tweets and news headlines.
  • Tested GPT versions (3.5 Turbo, 4, 4 Turbo) for detecting psychological constructs (sentiment, emotions, offensiveness, moral foundations) across 12 languages.
  • Compared GPT performance with English-language dictionary analysis and established machine learning models.

Main Results:

  • GPT models (r = 0.59 to 0.77) significantly outperformed English-language dictionary analysis (r = 0.20 to 0.30).
  • GPT performance was comparable to, and sometimes exceeded, top-performing fine-tuned machine learning models.
  • Performance improved with newer GPT versions, especially for less common languages, and costs decreased.

Conclusions:

  • GPT models provide a highly accurate, versatile, and user-friendly alternative for automated psychological text analysis.
  • GPT's ability to function without training data and with simple prompts democratizes advanced NLP for researchers, including those studying under-resourced languages.
  • LLMs facilitate cross-linguistic research and make sophisticated text analysis more accessible to a broader scientific community.