Jove
Visualize
Contact Us

Related Concept Videos

Sampling Continuous Time Signal01:11

Sampling Continuous Time Signal

666
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
666
Random Sampling Method01:09

Random Sampling Method

14.1K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
14.1K
Randomized Experiments01:13

Randomized Experiments

8.8K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
8.8K
Sampling Plans01:23

Sampling Plans

875
Sampling is a crucial step in analytical chemistry, allowing researchers to collect representative data from a large population. Common sampling methods include random, judgmental, systematic, stratified, and cluster sampling.
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
875
Sampling Methods: Overview01:06

Sampling Methods: Overview

2.1K
A sample refers to a smaller subset representative of a larger population. In analytical chemistry, studying or analyzing an entire population is often impractical or impossible. Therefore, samples are used to draw inferences and generalize the whole population. The sampling method selects individuals or items from a population to create a sample. Standard sampling methods include random, judgemental, systematic, stratified, and cluster sampling. 
In analytical chemistry, the choice of...
2.1K
Sampling Distribution01:12

Sampling Distribution

16.6K
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
16.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent based temporal optimization approach for improving the performance of collaborative filtering.

PeerJ. Computer science·2021
Same author

Sustainable management of water demand using fuzzy inference system: a case study of Kenyir Lake, Malaysia.

Environmental science and pollution research international·2021
Same author

Coronary artery center-line extraction using second order local features.

Computational and mathematical methods in medicine·2012
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Dual experience replay enhanced deep deterministic policy gradient for efficient continuous data sampling.

Teh Noranis Mohd Aris1, Ningning Chen1, Norwati Mustapha1

  • 1Department of Computer Science, Universiti Putra Malaysia, UPM, Serdang, Selangor, Malaysia.

Plos One
|November 11, 2025
PubMed
Summary
This summary is machine-generated.

We introduce TPDEB, a dual experience replay framework for asynchronous distributed reinforcement learning. It enhances sample efficiency and policy stability, improving convergence speed and performance in continuous control tasks.

Related Experiment Videos

Area of Science:

  • Artificial Intelligence
  • Machine Learning
  • Robotics

Background:

  • Distributed reinforcement learning (RL) systems face challenges with sample utilization and policy stability due to network delays and asynchronous updates.
  • Existing methods struggle with robust learning under asynchronous conditions, limiting scalability in real-world applications.

Purpose of the Study:

  • To propose TPDEB, a dual experience replay framework designed to improve sample efficiency and policy stability in asynchronous distributed RL.
  • To enhance convergence speed and robustness in continuous control tasks.

Main Methods:

  • TPDEB utilizes a dual-buffer strategy combining standard and prioritized experience replay buffers.
  • It incorporates trajectory-level prioritized sampling for high-value experiences and KL-regularized learning to constrain policy drift.
  • The framework scales parallel actor replicas to collect diverse and redundant experience.

Main Results:

  • TPDEB demonstrated superior convergence speed and final performance compared to baseline distributed RL algorithms on MuJoCo benchmarks.
  • Performance gains were particularly notable under constrained actor-learner bandwidth conditions.
  • Ablation studies confirmed the effectiveness of trajectory-level prioritization and KL-regularization in improving learning.

Conclusions:

  • TPDEB offers a practical and scalable solution for asynchronous distributed reinforcement learning.
  • The dual-buffer approach and specific regularization techniques effectively address limitations in sample utilization and policy instability.
  • This framework significantly advances the robustness and efficiency of RL in complex control tasks.