Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Decision Making: P-value Method

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...

Accuracy, limits, and approximation

Accuracy, limits, and approximation

Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...

Testing a Claim about Standard Deviation

Testing a Claim about Standard Deviation

A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...

Expected Value

Expected Value

The expected value is known as the "long-term" average or mean. This means that over the long term of experimenting over and over, you would expect this average. The expected average is represented by the symbol μ. It is calculated as follows:

Detection of Gross Error: The Q Test

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...

Confidence Coefficient

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Interpretable noninvasive diagnosis of tuberculous pleural effusion using LGBM and SHAP: development and clinical application of a machine learning model.

PeerJ·2025

Same author

A virulence protein activates SERK4 and degrades RNA polymerase IV protein to suppress rice antiviral immunity.

Developmental cell·2025

Same author

Enhanced accumulation of indole glucosinolate and resistance to insect and pathogen in flowering Chinese cabbage by overexpression of Arabidopsis CYP79B2 and CYP83B1.

Pest management science·2025

Same author

<i>Borrelia burgdorferi</i> Strain-Specific Differences in Mouse Infectivity and Pathology.

Pathogens (Basel, Switzerland)·2025

Same author

Transcriptomic analysis of wrinkled leaf development of Tai-cai (Brassica rapa var. tai-tsai) and its synthetic allotetraploid via RNA and miRNA sequencing.

Plant molecular biology·2025

Same author

Phenylpropanoid Metabolites Mediate Antiviral Defense and Vector Resistance in Rice Infected With RRSV, RGSV, and SRBSDV.

Plant, cell & environment·2025

Search research articles

Related Experiment Video

Updated: Sep 9, 2025

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Published on: September 19, 2012

Pseudo-distribution elite critics: Enhancing accuracy in reinforcement learning value estimation.

Yujia Zhang¹, Lin Li², Wei Wei²

¹School of Computer Science and Technology, North University of China, Taiyuan, 030051, Shanxi, China.

Neural Networks : the Official Journal of the International Neural Network Society

|August 28, 2025

Summary

Pseudo-distribution Elite Critics (PEC) improve reinforcement learning by balancing Q-value biases. This novel approach enhances sample efficiency and agent performance in complex environments.

Keywords:

Pseudo-distribution representation Reinforcement learning Uncertainty measurement Value estimation

More Related Videos

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

Related Experiment Videos

Last Updated: Sep 9, 2025

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Published on: September 19, 2012

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

Area of Science:

Artificial Intelligence
Machine Learning
Reinforcement Learning

Background:

Reinforcement learning (RL) agents excel in complex environments but suffer from state-action value estimation biases.
Overestimation and underestimation biases in Q-value approximations limit sample efficiency and performance.

Purpose of the Study:

Introduce the Pseudo-distribution Elite Critics (PEC) framework to enhance RL sample efficiency.
Address and balance overestimation and underestimation biases in Q-value approximations.
Improve the precision and reliability of Q-value estimations in intelligent agents.

Main Methods:

Utilize a pseudo-distribution representation to enrich Q-value approximations with distributional characteristics.
Incorporate an uncertainty measurement to select the most reliable critic for Temporal Difference (TD) target computation.
Employ a trimmed mean technique to balance optimistic and pessimistic biases in TD targets.

Main Results:

PEC demonstrates statistically significant improvements in reinforcement learning tasks.
The framework shows superior performance compared to existing methodologies in benchmark scenarios.
PEC effectively enhances sample efficiency and refines Q-value estimations.

Conclusions:

The Pseudo-distribution Elite Critics (PEC) framework offers a robust solution to Q-value estimation biases in RL.
PEC enhances agent performance and sample efficiency through distributional enrichment and bias balancing.
This innovative approach represents a significant advancement in developing more adept intelligent agents.