Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Probability Histograms

Probability Histograms

A probability histogram is a visual representation of a probability distribution. Similar a typical histogram, the probability histogram consists of contiguous (adjoining) boxes. It has both a horizontal axis and a vertical axis. The horizontal axis is labeled with what the data represents. The vertical axis is labeled with probability. Each rectangular bar in the histogram is 1 unit wide, which suggests that the area under each bar equals the probability, P(x), where x is 1, 2, 3, and so on.

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for k_a Estimation

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...

Binomial Probability Distribution

Binomial Probability Distribution

A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...

Probability Distributions

Probability Distributions

The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson probability...

Decision Making: P-value Method

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...

Distributions to Estimate Population Parameter

Distributions to Estimate Population Parameter

The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Generalizing CMAC architecture and training.

IEEE transactions on neural networks·2008

Same author

Sample selection via clustering to construct support vector-like classifiers.

IEEE transactions on neural networks·2008

Same author

On the structure of strict sense Bayesian cost functions and its applications.

IEEE transactions on neural networks·2008

Same author

Weighted least squares training of support vector classifiers leading to compact and adaptive schemes.

IEEE transactions on neural networks·2008

Same author

Empirical risk minimization for support vector classifiers.

IEEE transactions on neural networks·2008

Same author

Efficient block training of multilayer perceptrons.

Neural computation·2000

Search research articles

Related Experiment Video

Updated: Jul 7, 2026

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

Cost functions to estimate a posteriori probabilities in multiclass problems.

J Cid-Sueiro¹, J I Arribas, S Urbán-Muñoz

¹Departamento de Teoría de la Señal y Comunicaciones e Ing. Telemática, ETSIT, Universidad de Valladolid, Campus Miguel Delibes s/n, 47011 Valladolid, Spain.

IEEE Transactions on Neural Networks

|February 7, 2008

Summary

This study defines conditions for cost functions estimating posterior probabilities in multiclass problems. A universal learning rule is presented for single-layer networks using these cost functions.

More Related Videos

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Related Experiment Videos

Last Updated: Jul 7, 2026

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Area of Science:

Machine Learning
Artificial Intelligence
Probability Theory

Background:

Designing effective cost functions is crucial for accurate posterior probability estimation in multiclass classification.
Existing cost functions may not always satisfy desired properties like symmetry and separability.
Ensuring network outputs align with probability laws is a key challenge.

Purpose of the Study:

To establish necessary and sufficient conditions for cost functions in one-class, one-output networks.
To analyze cost functions with symmetry and separability properties.
To introduce a universal learning rule for minimizing generalized cost functions.

Main Methods:

Derivation of theoretical conditions for cost function validity.
Focus on cost functions exhibiting symmetry and separability.
Development of a stochastic gradient learning rule for single-layer networks.

Main Results:

Identified necessary and sufficient conditions for valid cost functions in specific network architectures.
Characterized a subset of cost functions including quadratic cost and cross-entropy.
Presented a universal stochastic gradient learning rule applicable to various nonlinear activation functions.

Conclusions:

The established conditions provide a theoretical foundation for designing cost functions.
The proposed learning rule offers a flexible approach for training neural networks.
This work advances the understanding and application of cost functions in probabilistic machine learning.