Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Practice variation and limited adoption of evidence in POPF prevention after pancreatoduodenectomy: an international E-AHPBA-endorsed survey.

HPB : the official journal of the International Hepato Pancreato Biliary Association·2026

Same author

Measurement of Cognitive and Kinematic Adaptation in Exoskeleton-Assisted Locomotion: Validation of an XR-Based Framework.

Sensors (Basel, Switzerland)·2026

Same author

A perspective on neuromechanical biomarkers for neurorehabilitation: towards reliable assessment in research and clinical practice.

Progress in biomedical engineering (Bristol, England)·2026

Same author

Evaluation of robotic mobility-assistive devices for older adults: a mixed-methods online study.

Disability and rehabilitation. Assistive technology·2026

Same author

Assessing upper limb function: the Spanish version of the Stroke Upper Limb Capacity Scale (SULCS): cross-cultural adaptation and clinimetric properties.

Neurological sciences : official journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology·2026

Same author

AI-based planning for DIEAP flap procedures: exploring foundation models for artery perforators analysis.

Frontiers in medicine·2026

Search research articles

Related Experiment Video

Updated: Aug 28, 2025

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

Making Bipedal Robot Experiments Reproducible and Comparable: The Eurobench Software Approach.

Anthony Remazeilles¹, Alfonso Dominguez¹, Pierre Barralon¹

¹TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastián, Spain.

Frontiers in Robotics and AI

|September 15, 2022

Summary

This study introduces a software methodology for systematically benchmarking bipedal systems like humanoids and prosthetics. It standardizes performance indicator computation, ensuring reproducible and comparable experimental results.

Keywords:

algorithm benchmarking exoskeleton humanoid performance indicator replicability software

More Related Videos

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Published on: July 22, 2014

A Novel Single Animal Motor Function Tracking System Using Simple, Readily Available Software

A Novel Single Animal Motor Function Tracking System Using Simple, Readily Available Software

Published on: August 31, 2018

Related Experiment Videos

Last Updated: Aug 28, 2025

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Published on: July 22, 2014

A Novel Single Animal Motor Function Tracking System Using Simple, Readily Available Software

A Novel Single Animal Motor Function Tracking System Using Simple, Readily Available Software

Published on: August 31, 2018

Area of Science:

Robotics
Biomechanics
Software Engineering

Background:

Systematic benchmarking of bipedal systems (humanoids, exoskeletons, prosthetics) is crucial for performance evaluation.
Existing methods lack standardization in data handling, algorithm definition, and implementation, hindering reproducibility.
The European project Eurobench has gathered numerous protocols and testbeds for characterizing bipedal system performance.

Purpose of the Study:

To propose a software methodology for the systematic benchmarking of bipedal systems.
To address the challenge of standardizing the scoring process for experimental data.
To ensure reproducibility and replicability of performance indicator computations.

Main Methods:

Developed a methodology constraining software interfaces for scoring algorithms.
Utilized continuous integration and deployment tools for software verification.
Employed dockerization to create language-independent, executable instances of algorithms.

Main Results:

A standardized methodology for preparing and implementing scoring algorithms has been established.
The approach ensures reproducibility and replicability of benchmarking results.
Metrics and documentation repositories adhering to this policy are available within the Eurobench project.

Conclusions:

The proposed methodology simplifies the development and execution of benchmarking algorithms for bipedal systems.
This standardization facilitates easier reproduction, replication, and comparison of experimental results across different studies.
The approach is adaptable for application to other protocols and metrics, enhancing the field of bipedal system evaluation.