Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Observational Learning01:12

Observational Learning

362
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
362
Three-Dimensional Force System:Problem Solving01:30

Three-Dimensional Force System:Problem Solving

948
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
948
Laminar Flow: Problem Solving01:24

Laminar Flow: Problem Solving

270
Laminar flow occurs when a fluid moves smoothly in parallel layers with minimal mixing and turbulence. In fluid mechanics, ensuring laminar flow within a pipe is essential for precise control of flow characteristics, especially in engineering applications. The key factor in determining whether flow remains laminar is the Reynolds number, a dimensionless quantity that depends on the fluid's velocity, density, viscosity, and the pipe's diameter. A Reynolds number of 2100 or lower...
270
Reinforcement01:23

Reinforcement

420
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
420
Two-Dimensional Force System: Problem Solving01:29

Two-Dimensional Force System: Problem Solving

748
Solving problems related to two-dimensional force systems is an essential aspect of mechanics and engineering. By applying the principles of vector analysis and force equilibrium, one can determine the effect of multiple forces acting on an object in a two-dimensional space.
The first step to solving a two-dimensional force system problem is to draw a free-body diagram of the object under consideration. This diagram helps identify all the external forces acting on the object, including their...
748

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The undulating tripod gait as a model of the locomotion of walking fish.

Nature communications·2026
Same author

Epidermal deletion of Kindlin-1 drives matrix changes in the mouse skin and altered responses to ultraviolet radiation.

Journal of dermatological science·2026
Same author

A minimalistic walking fish robot twin based on the single actuator wave-like mechanism.

Bioinspiration & biomimetics·2025
Same author

Scalable mobile swarm network for reservoir computing using gaussian kernel density estimation.

Neural networks : the official journal of the International Neural Network Society·2025
Same author

Soft robotics: what's next in bioinspired design and applications of soft robots?

Bioinspiration & biomimetics·2025
Same author

Soft Shear Sensing of Robotic Twisting Tasks Using Reduced-Order Conductivity Modeling.

Sensors (Basel, Switzerland)·2025

Related Experiment Video

Updated: Oct 7, 2025

Long-term Behavioral Tracking of Freely Swimming Weakly Electric Fish
10:56

Long-term Behavioral Tracking of Freely Swimming Weakly Electric Fish

Published on: March 6, 2014

12.7K

Manipulation of free-floating objects using Faraday flows and deep reinforcement learning.

David Hardman1, Thomas George Thuruthel2, Fumiya Iida1

  • 1Bio-Inspired Robotics Lab, Department of Engineering, University of Cambridge, Cambridge, CB2 1PZ, UK.

Scientific Reports
|January 11, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces a new deep reinforcement learning method for controlling free-floating objects in water. The data-driven approach enables efficient, scalable, and multi-directional motion control, overcoming limitations of previous methods.

More Related Videos

Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

8.9K
Fabrication of Magnetic Platforms for Micron-Scale Organization of Interconnected Neurons
09:54

Fabrication of Magnetic Platforms for Micron-Scale Organization of Interconnected Neurons

Published on: July 14, 2021

5.0K

Related Experiment Videos

Last Updated: Oct 7, 2025

Long-term Behavioral Tracking of Freely Swimming Weakly Electric Fish
10:56

Long-term Behavioral Tracking of Freely Swimming Weakly Electric Fish

Published on: March 6, 2014

12.7K
Investigating Motor Skill Learning Processes with a Robotic Manipulandum
07:52

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

8.9K
Fabrication of Magnetic Platforms for Micron-Scale Organization of Interconnected Neurons
09:54

Fabrication of Magnetic Platforms for Micron-Scale Organization of Interconnected Neurons

Published on: July 14, 2021

5.0K

Area of Science:

  • Robotics and Control Systems
  • Fluid Dynamics
  • Artificial Intelligence

Background:

  • Controlling free-floating objects via fluid surface flows is crucial for many applications.
  • Existing methods are limited to uni-directional control due to complex dynamics and underactuation.
  • Analytical modeling is challenging due to high-dimensional, mixed surface flows and nonlinear fluid dynamics.

Purpose of the Study:

  • To develop a novel methodology for precise, multi-directional remote manipulation of free-floating objects.
  • To address the limitations of current uni-directional control methods in fluidic environments.
  • To leverage deep reinforcement learning for complex nonlinear control problems.

Main Methods:

  • Utilized large-scale physical experimentation with a robotic arm for object manipulation in water.
  • Applied deep reinforcement learning (DRL) techniques to learn a control policy.
  • Demonstrated open-loop control for free-floating object manipulation.

Main Results:

  • Developed a data-driven control policy that is quick to train and highly data-efficient.
  • The learned policy demonstrated scalability to higher-dimensional parameter spaces and experimental scenarios.
  • Successfully achieved multi-directional control of a free-floating object, surpassing previous limitations.

Conclusions:

  • Data-driven approaches, particularly DRL, show significant potential for solving complex nonlinear control problems in fluid dynamics.
  • The proposed methodology offers an efficient and scalable solution for remote manipulation of free-floating objects.
  • This research opens new avenues for advanced robotic control in challenging fluidic environments.