Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: May 1, 2026

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Published on: November 7, 2025

Rodent Social Behavior Recognition Using a Global Context-Aware Vision Transformer Network.

Muhammad Imran Sharif¹, Doina Caragea¹, Ahmed Iqbal²

¹Department of Computer Science, Kansas State University, Manhattan, KS 66506, USA.

AI (Basel, Switzerland)

|April 30, 2026

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Neural network based molecular structure retrieval from Coulomb explosion imaging data.

The Journal of chemical physics·2026

Same author

The shifting landscape of vaccine discourse: Insights from a decade of pre- to post-COVID-19 vaccine posts on social media.

PloS one·2025

Same author

Machine Learning, Generalization, and Transfer Learning for Predicting the Exceedance of Fecal Indicator Bacteria Thresholds at Beaches.

Environmental science & technology·2025

Same author

Using recurrent neural networks to detect supernumerary chromosomes in fungal strains causing blast diseases.

NAR genomics and bioinformatics·2024

Same author

Deep Learning for Alzheimer's Disease Prediction: A Comprehensive Review.

Diagnostics (Basel, Switzerland)·2024

Same author

A Comparative Analysis of Optimization Algorithms for Gastrointestinal Abnormalities Recognition and Classification Based on Ensemble XcepNet23 and ResNet18 Features.

Biomedicines·2023

Same journal

Artificial Intelligence at the Intersection of Chemistry and Materials Science.

AI (Basel, Switzerland)·2026

Same journal

Monitoring Substance Use with Fitbit Biosignals: A Case Study on Training Deep Learning Models Using Ecological Momentary Assessments and Passive Sensing.

AI (Basel, Switzerland)·2025

Same journal

Audio-Based Emotion Recognition Using Self-Supervised Learning on an Engineered Feature Space.

AI (Basel, Switzerland)·2024

Same journal

Can Artificial Intelligence Aid Diagnosis by Teleguided Point-of-Care Ultrasound? A Pilot Study for Evaluating a Novel Computer Algorithm for COVID-19 Diagnosis Using Lung Ultrasound.

AI (Basel, Switzerland)·2023

Same journal

Can Sequential Images from the Same Object Be Used for Training Machine Learning Models? A Case Study for Detecting Liver Disease by Ultrasound Radiomics.

AI (Basel, Switzerland)·2022

See all related articles

This study introduces Vision Transformer for Rat Social Interactions (ViT-RSI), an AI model for automated animal behavior recognition. ViT-RSI accurately identifies rodent social behaviors, outperforming previous methods in key interaction categories.

Area of Science:

Neuroscience and computational biology
Utilizes advanced computer vision for animal behavior analysis.

Background:

Manual animal behavior coding is time-consuming and error-prone.
Machine learning offers automated solutions for analyzing animal behavior.
Existing methods require improvement for accurate rodent social interaction identification.

Purpose of the Study:

To develop and evaluate an automated system for recognizing rat social behaviors.
To leverage state-of-the-art computer vision, specifically the Global Context Vision Transformer (GC-ViT), for this task.

Main Methods:

Proposed a novel approach: Vision Transformer for Rat Social Interactions (ViT-RSI).
Adapted the GC-ViT architecture for identifying social interactions in rodents.
Utilized the publicly available Rat Social Interaction (RatSI) dataset for experiments.

Keywords:

RatSI dataset behavior recognition deep learning global context-aware network rodent social behavior vision transformer (ViT)

More Related Videos

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Published on: July 10, 2019

Related Experiment Videos

Last Updated: May 1, 2026

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Utilizing vmTracking to Improve the Accuracy of Multi-Animal Pose Estimation in Rodent Social Behavior Studies

Published on: November 7, 2025

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Automated Rat Single-Pellet Reaching with 3-Dimensional Reconstruction of Paw and Digit Trajectories

Published on: July 10, 2019

Main Results:

ViT-RSI achieved high accuracy in identifying five distinct rat social behaviors.
The model outperformed prior literature results for four behaviors: Approaching (F1=0.81), Following (F1=0.81), Moving away (F1=0.86), and Solitary (F1=0.94).

Conclusions:

The ViT-RSI approach demonstrates significant potential for accurate and automated animal behavior analysis.
This method offers a more efficient and reliable alternative to manual coding in research settings.
ViT-RSI advances the field of machine learning applications in behavioral neuroscience.