Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies
  1. Home
  3. Rodent Social Behavior Recognition Using A Global Context-aware Vision Transformer Network.
  1. Home
  3. Rodent Social Behavior Recognition Using A Global Context-aware Vision Transformer Network.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Neural network based molecular structure retrieval from Coulomb explosion imaging data.

The Journal of chemical physics·2026
Same author

The shifting landscape of vaccine discourse: Insights from a decade of pre- to post-COVID-19 vaccine posts on social media.

PloS one·2025
Same author

Machine Learning, Generalization, and Transfer Learning for Predicting the Exceedance of Fecal Indicator Bacteria Thresholds at Beaches.

Environmental science & technology·2025
Same author

Using recurrent neural networks to detect supernumerary chromosomes in fungal strains causing blast diseases.

NAR genomics and bioinformatics·2024
Same author

Deep Learning for Alzheimer's Disease Prediction: A Comprehensive Review.

Diagnostics (Basel, Switzerland)·2024
Same author

A Comparative Analysis of Optimization Algorithms for Gastrointestinal Abnormalities Recognition and Classification Based on Ensemble XcepNet23 and ResNet18 Features.

Biomedicines·2023
Same journal

Artificial Intelligence at the Intersection of Chemistry and Materials Science.

AI (Basel, Switzerland)·2026
Same journal

Monitoring Substance Use with Fitbit Biosignals: A Case Study on Training Deep Learning Models Using Ecological Momentary Assessments and Passive Sensing.

AI (Basel, Switzerland)·2025
Same journal

Audio-Based Emotion Recognition Using Self-Supervised Learning on an Engineered Feature Space.

AI (Basel, Switzerland)·2024
Same journal

Can Artificial Intelligence Aid Diagnosis by Teleguided Point-of-Care Ultrasound? A Pilot Study for Evaluating a Novel Computer Algorithm for COVID-19 Diagnosis Using Lung Ultrasound.

AI (Basel, Switzerland)·2023
Same journal

Can Sequential Images from the Same Object Be Used for Training Machine Learning Models? A Case Study for Detecting Liver Disease by Ultrasound Radiomics.

AI (Basel, Switzerland)·2022
See all related articles

Related Experiment Video

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies
07:34

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Published on: November 7, 2025

548

Rodent Social Behavior Recognition Using a Global Context-Aware Vision Transformer Network.

Muhammad Imran Sharif1, Doina Caragea1, Ahmed Iqbal2

  • 1Department of Computer Science, Kansas State University, Manhattan, KS 66506, USA.

AI (Basel, Switzerland)
|April 30, 2026

View abstract on PubMed

Summary
This summary is machine-generated.

This study introduces Vision Transformer for Rat Social Interactions (ViT-RSI), an AI model for automated animal behavior recognition. ViT-RSI accurately identifies rodent social behaviors, outperforming previous methods in key interaction categories.

Keywords:
RatSI datasetbehavior recognitiondeep learningglobal context-aware networkrodent social behaviorvision transformer (ViT)

More Related Videos

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories
07:52

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Published on: July 10, 2019

13.7K

Related Experiment Videos

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies
07:34

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Published on: November 7, 2025

548
Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories
07:52

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Published on: July 10, 2019

13.7K

Area of Science:

  • Neuroscience and computational biology
  • Utilizes advanced computer vision for animal behavior analysis.

Background:

  • Manual animal behavior coding is time-consuming and error-prone.
  • Machine learning offers automated solutions for analyzing animal behavior.
  • Existing methods require improvement for accurate rodent social interaction identification.

Purpose of the Study:

  • To develop and evaluate an automated system for recognizing rat social behaviors.
  • To leverage state-of-the-art computer vision, specifically the Global Context Vision Transformer (GC-ViT), for this task.

Main Methods:

  • Proposed a novel approach: Vision Transformer for Rat Social Interactions (ViT-RSI).
  • Adapted the GC-ViT architecture for identifying social interactions in rodents.
  • Utilized the publicly available Rat Social Interaction (RatSI) dataset for experiments.

Main Results:

  • ViT-RSI achieved high accuracy in identifying five distinct rat social behaviors.
  • The model outperformed prior literature results for four behaviors: Approaching (F1=0.81), Following (F1=0.81), Moving away (F1=0.86), and Solitary (F1=0.94).

Conclusions:

  • The ViT-RSI approach demonstrates significant potential for accurate and automated animal behavior analysis.
  • This method offers a more efficient and reliable alternative to manual coding in research settings.
  • ViT-RSI advances the field of machine learning applications in behavioral neuroscience.