Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Control Systems01:10

Control Systems

Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
Time-Domain Interpretation of PD Control01:07

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Open and closed-loop control systems01:17

Open and closed-loop control systems

Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal and...
Feedback control systems01:26

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Controller Configurations01:22

Controller Configurations

Controller configurations are crucial in a car's cruise control system because they manage speed over time to maintain a consistent pace regardless of road conditions, thereby meeting design goals. In traditional control systems, fixed-configuration design involves predetermined controller placement. System performance modifications are known as compensation.
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
PI Controller: Design01:24

PI Controller: Design

Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatryยท2026
Same author

Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum.

eLifeยท2026
Same author

Uncertainty for better and worse.

Current opinion in neurobiologyยท2026
Same author

Dopamine dynamics in human anterior cingulate cortex during Pavlovian-instrumental conflict.

bioRxiv : the preprint server for biologyยท2026
Same author

Modality-general sensitivity of pupil responses to regularity violations.

Cognitive, affective & behavioral neuroscienceยท2026
Same author

Metacognitive efficiency in learned value-based choice.

PLoS computational biologyยท2026
Same journal

A boundary-regularization-enhanced video anomaly detection network based on context-adaptive spatio-temporal conditional diffusion.

Neural networks : the official journal of the International Neural Network Societyยท2026
Same journal

MT<sup>2</sup>-CSD and LLM-CRAN: A new dataset and an LLM-based multi-semantic knowledge fusion model for conversational stance detection.

Neural networks : the official journal of the International Neural Network Societyยท2026
Same journal

TriAlignNet: A triple-path cross-modality alignment framework for multimodal time series forecasting.

Neural networks : the official journal of the International Neural Network Societyยท2026
Same journal

Anchor-based disentanglement framework for incremental multi-view clustering.

Neural networks : the official journal of the International Neural Network Societyยท2026
Same journal

Complex-valued amplitude-phase interference modeling for adversarially robust classification.

Neural networks : the official journal of the International Neural Network Societyยท2026
Same journal

TraNce: Type-aware hypergraph neural network with biological mediators for drug repositioning.

Neural networks : the official journal of the International Neural Network Societyยท2026
See all related articles

Related Experiment Video

Updated: Jun 24, 2026

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
09:01

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

Published on: April 4, 2017

Goal-directed control and its antipodes.

Peter Dayan1

  • 1UCL, 17 Queen Square, London WC1N 3AR, UK. dayan@gatsby.ucl.ac.uk

Neural Networks : the Official Journal of the International Neural Network Society
|April 14, 2009
PubMed
Summary
This summary is machine-generated.

This review clarifies goal-directed control in instrumental conditioning, distinguishing it from other behaviors. It examines reinforcement learning and cognitive architectures to bridge current research gaps.

More Related Videos

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Related Experiment Videos

Last Updated: Jun 24, 2026

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques
09:01

Gain-compensation Methodology for a Sinusoidal Scan of a Galvanometer Mirror in Proportional-Integral-Differential Control Using Pre-emphasis Techniques

Published on: April 4, 2017

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Artificial Intelligence

Background:

  • Instrumental conditioning precisely defines goal-directed control, creating a clear distinction from less defined opposing behaviors.
  • Existing research in reinforcement learning and cognitive architectures presents various, sometimes disconnected, perspectives on control mechanisms.

Purpose of the Study:

  • To review and clarify the distinctions surrounding goal-directed control in instrumental conditioning.
  • To integrate diverse concepts like declarative/procedural control and environmental priors within control frameworks.
  • To reconnect disparate research areas in the study of behavioral control.

Main Methods:

  • Literature review of instrumental conditioning, reinforcement learning, and cognitive architectures.
  • Analysis of distinctions including declarative vs. procedural control.
  • Examination of environmental prior distributions and neural substrates.

Main Results:

  • A clearer conceptual boundary is established between goal-directed control and its alternatives.
  • Identified key distinctions relevant to understanding control mechanisms.
  • Highlighted differing views on the rationality of various control strategies.

Conclusions:

  • Reconnecting the study of goal-directed control with related fields like reinforcement learning is crucial.
  • A unified understanding of control mechanisms requires integrating insights from cognitive science and neuroscience.
  • Further research can bridge the gap between precise definitions and broader applications of control theory.