Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Randomized Experiments01:13

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
Prediction Intervals01:03

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y. 
The...
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model01:13

Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model

Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Inference on summaries of a model-agnostic longitudinal variable importance trajectory with application to suicide prevention.

The annals of applied statistics·2026
Same author

A SEQUENTIAL SIGNIFICANCE TEST FOR TREATMENT BY COVARIATE INTERACTIONS.

Statistica Sinica·2026
Same author

Incidence and risk factors of <i>C. trachomatis</i>, <i>N. gonorrhoeae</i> and syphilis among a cohort of urban Canadian gay, bisexual and other men who have sex with men, 2017-2023: informing the potential impact of doxycycline prophylaxis.

BMJ open·2026
Same author

Metabolic Dysfunction-Associated Steatotic Liver Disease Is Associated With Impaired Health-Related Quality of Life in People With HIV.

Gastro hep advances·2026
Same author

Personalized treatment hierarchies in Bayesian network meta-analysis.

Research synthesis methods·2026
Same author

Reimbursement restrictions reduce liver fibrosis screening in adults with diabetes in Ontario: a population-based interrupted time series analysis.

Scientific reports·2026

Related Experiment Videos

Q-learning for estimating optimal dynamic treatment rules from observational data.

Erica E M Moodie1, Bibhas Chakraborty, Michael S Kramer

  • 1McGill University, Department of Epidemiology, Biostatistics, and Occupational Health, QC, Canada H3A 1A2.

The Canadian Journal of Statistics = Revue Canadienne De Statistique
|January 29, 2013
PubMed
Summary
This summary is machine-generated.

This study extends Q-learning for dynamic treatment regimes (DTR) to observational data, incorporating confounding covariates. The methods are validated for adaptive clinical decision-making, improving treatment recommendations.

Related Experiment Videos

Area of Science:

  • Dynamic treatment regimes (DTR) for adaptive, multistage clinical decision-making.
  • Reinforcement learning and statistical inference for personalized medicine.

Background:

  • Q-learning is a reinforcement learning method applied to estimate DTRs.
  • Existing applications of Q-learning are limited to randomized treatment data.
  • Confounding covariates present a challenge in observational studies for DTR estimation.

Purpose of the Study:

  • To extend Q-learning methods for estimating dynamic treatment regimes (DTRs) using observational data.
  • To incorporate measured confounding covariates into DTR estimation.
  • To evaluate the performance of these extended methods in various settings, including non-regular scenarios.

Main Methods:

  • Extension of Q-learning to handle observational data with confounding.
  • Application of direct adjustment and propensity score methods for covariate adjustment.
  • Evaluation of methods under diverse statistical conditions.

Main Results:

  • The extended Q-learning methods successfully incorporate confounding covariates for DTR estimation.
  • The proposed approaches are effective in both regular and non-regular statistical settings.
  • Demonstrated application in analyzing the effect of breastfeeding on child vocabulary development.

Conclusions:

  • Q-learning can be effectively adapted for DTR estimation in observational studies with confounding.
  • The developed methods offer a robust framework for data-driven clinical decision-making.
  • Provides tools for causal inference in complex treatment scenarios.