Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Empathy02:34

Empathy

9.6K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor. 
9.6K
Labeling Emotion01:20

Labeling Emotion

196
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
196
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

198
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
198
Physiology of Emotion01:20

Physiology of Emotion

1.0K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.0K
Nonconscious Mimicry01:13

Nonconscious Mimicry

4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K
Social Proof00:52

Social Proof

27.7K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

AI-based modeling of treatment decisions in benign prostatic hyperplasia: a transformer-based comparative study.

BMC medical informatics and decision making·2026
Same author

Comparing Postoperative Outcomes Between Laparoscopic-Assisted Percutaneous Internal Ring Suturing and Laparoscopic Intracorporeal Internal Ring Suturing in the Management of Paediatric Inguinal Herniae: A Retrospective Review in Jordan.

Cureus·2025
Same author

Hybrid AI Framework for the Early Detection of Heart Failure: Integrating Traditional Machine Learning and Generative Language Models With Clinical Data.

Cureus·2025
Same author

MAD-Onto: an ontology design for mobile app development.

Frontiers in artificial intelligence·2025
Same author

Credibility-based knowledge graph embedding for identifying social brand advocates.

Frontiers in big data·2024
Same author

Arabic Wikipedia users' personalized behavior analysis considering gender gap.

PloS one·2024

Related Experiment Video

Updated: Jul 30, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

3.9K

Emotion detection of social data: APIs comparative study.

Bilal Abu-Salih1,2, Mohammad Alhabashneh2, Dengya Zhu2

  • 1The University of Jordan, Amman, Jordan.

Heliyon
|May 14, 2023
PubMed
Summary

This study evaluates eight different software tools designed to identify human emotions in social media text. By testing these tools on the same datasets, the researchers provide a clear comparison of their accuracy and reliability, helping businesses choose the best technology for their specific needs.

Keywords:
Application programming interfacesCommercial toolsComparative studyEmotion analysisEmotion detectionSocial emotion analysissentiment analysisAPI benchmarkingtextual classificationperformance evaluation

Frequently Asked Questions

More Related Videos

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans
04:27

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

Published on: March 15, 2019

11.2K
Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions
10:45

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Published on: July 6, 2011

11.7K

Related Experiment Videos

Last Updated: Jul 30, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

3.9K
Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans
04:27

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

Published on: March 15, 2019

11.2K
Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions
10:45

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Published on: July 6, 2011

11.7K

Area of Science:

  • Computational linguistics and emotion detection research within data science
  • Information systems and software engineering performance evaluation

Background:

No prior work had resolved how various automated sentiment analysis tools perform when applied to identical social media inputs. That uncertainty drove the need for a systematic evaluation of commercial and open-source software. Prior research has shown that digital marketplaces are rapidly expanding with new applications for identifying user feelings. This gap motivated a closer look at the reliability of these emerging technologies. It was already known that many start-ups now focus exclusively on building recognition interfaces for corporate use. However, the consistency of these outputs remains largely unverified across different platforms. This study addresses the lack of empirical evidence regarding how these models compare using standardized benchmarks. Such investigations are necessary to ensure that businesses select tools that provide accurate and actionable insights from online interactions.

Purpose Of The Study:

The aim of this study is to provide a comprehensive empirical comparison of current emotion detection technologies using standardized benchmarks. The researchers seek to address the lack of existing research that evaluates these tools on identical textual datasets. By doing so, they intend to clarify how different commercial and open-source models perform when processing social media content. This investigation is motivated by the rapid growth of the digital marketplace and the increasing reliance on automated sentiment analysis. The authors recognize that businesses require reliable data to make informed decisions about which tools to integrate into their workflows. They propose that continuous evaluation is necessary to keep pace with the constant evolution of these software interfaces. The study specifically targets the gap in comparative literature regarding the accuracy of these models. Ultimately, the team provides a detailed report that serves as a practical guide for stakeholders in the corporate sector.

Main Methods:

The researchers adopted a comparative design to evaluate eight distinct sentiment analysis interfaces using two standardized text collections. They processed the input material through each selected tool to extract emotional classifications systematically. The team calculated performance using established statistical benchmarks like micro-average accuracy and classification error. They also computed precision, recall, and f1-score to provide a comprehensive view of model effectiveness. This approach allowed for a direct comparison of results obtained from the same underlying information. The authors aggregated the output scores to facilitate a clear ranking of the tested systems. They focused on identifying discrepancies in how different models interpret identical linguistic patterns. This methodology ensures that the reported findings reflect the actual capabilities of current commercial and open-source software.

Main Results:

The study reveals significant performance variations among the eight tested sentiment analysis tools when applied to identical social media inputs. The researchers reported specific outcomes based on micro-average accuracy, precision, recall, and f1-score for each model. They identified that classification error rates fluctuate considerably across the different platforms examined in the analysis. The findings demonstrate that no single tool consistently dominates across all evaluated metrics. The authors provided aggregated scores that highlight the strengths and weaknesses of each individual interface. These results indicate that the choice of technology directly impacts the reliability of the extracted emotional insights. The data shows that some models perform better at identifying specific categories of sentiment than others. The team successfully mapped the performance landscape, offering a clear view of how these technologies currently function in practice.

Conclusions:

The authors propose that benchmarking software performance is a vital step for organizations integrating automated sentiment analysis. Their synthesis suggests that significant variations exist between the eight tested models when processing identical social media inputs. The researchers indicate that standardized metrics like precision and recall offer a reliable framework for future tool selection. They conclude that no single interface consistently outperforms all others across every evaluated category. The findings imply that developers should prioritize specific metrics based on their unique business requirements. The team notes that the reported classification errors highlight the current limitations inherent in these automated systems. Their analysis provides a clear roadmap for stakeholders to navigate the crowded landscape of available sentiment recognition tools. These results serve as a foundation for ongoing improvements in the accuracy of digital emotion identification technologies.

The researchers utilized standard statistical metrics including micro-average accuracy, precision, recall, and f1-score to determine performance. These measures allow for a quantitative comparison of how well each tool correctly identifies specific emotional states within the provided textual samples.

The study examined eight distinct technologies, including IBM Watson Natural Language Understanding, ParallelDots, Symanto-Ekman, Crystalfeel, Text to Emotion, Senpy, Textprobe, and Natural Language Processing Cloud. Each model represents a different approach to processing and classifying human sentiment from digital text.

A standardized textual dataset was necessary to ensure that all models were tested under identical conditions. By using the same input for every tool, the authors could isolate performance differences attributable to the underlying algorithms rather than variations in the source material.

The researchers employed two separate datasets to test the capabilities of the chosen interfaces. These inputs served as the foundation for deriving emotional classifications, allowing the team to aggregate scores and calculate the final evaluation metrics for each system.

The team measured the classification error alongside other performance indicators to quantify the frequency of incorrect emotional assignments. This measurement provides a clearer picture of the reliability of each tool when handling complex or ambiguous social media language.

The authors suggest that their findings assist corporate entities in selecting appropriate tools for their specific operational goals. By reporting these performance benchmarks, they provide a guide for businesses to identify which technologies offer the most accurate results for their particular use cases.