Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Second-order learning algorithm with squared penalty term.

K Saito1, R Nakano

  • 1NTT Communication Science Laboratories, Seika-cho, Soraku-gun, Kyoto 619-0237 Japan.

Neural Computation
|April 19, 2000
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Enzymatic inactivation of tachykinin neurotransmitters in the isolated spinal cord of the newborn rat.

Neuroscience research·1992
Same author

Sensitive detection of p53 gene mutations in esophageal endoscopic biopsy specimens by cell sorting combined with polymerase chain reaction single-strand conformation polymorphism analysis.

Japanese journal of cancer research : Gann·1992
Same author

[A case of chronic fibrosing mediastinitis].

[Zasshi] [Journal]. Nihon Kyobu Geka Gakkai·1992
Same author

Differences in alpha 2u-globulins increased in male rat kidneys following treatment with several alpha 2u-globulin accumulating agents: cystein protease(s) play(s) an important role in production of kidney-type-alpha 2u-globulin.

Toxicology·1992
Same author

In vitro keratin expression of hair cells.

The Journal of dermatology·1992
Same author

Prognostic assessment of superficial squamous cell carcinoma of the esophagus using karyometric analysis and nucleolar organizer regions.

Journal of surgical oncology·1992
Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026
Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026
Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026
Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026
Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026
See all related articles

This study compares penalty terms for supervised learning. The squared penalty term with a second-order learning algorithm significantly enhances convergence and generalization performance.

Area of Science:

  • Machine Learning
  • Optimization Algorithms

Background:

  • Supervised learning models often require regularization to prevent overfitting.
  • Penalty terms are crucial for controlling model complexity and improving generalization.
  • Different penalty terms and learning algorithms can impact efficiency and performance.

Purpose of the Study:

  • To compare the efficiency of three penalty terms in supervised learning.
  • To evaluate the impact of first- and second-order learning algorithms on performance.
  • To identify optimal penalty factors using cross-validation.

Main Methods:

  • Utilized first- and second-order off-line learning algorithms.
  • Employed a first-order on-line learning algorithm.
  • Conducted function surface evaluations to analyze penalty term behavior.

Related Experiment Videos

  • Applied cross-validation for optimal penalty factor selection.

    • Main Results:

    • The squared penalty term combined with a second-order learning algorithm demonstrated superior convergence performance.
    • This combination also achieved excellent generalization performance compared to other methods.
    • Function surface evaluations provided insights into the distinct workings of each penalty term.

    Conclusions:

    • The squared penalty term and second-order learning algorithm offer a highly effective combination for supervised learning.
    • Cross-validation is a viable method for determining optimal penalty factors.
    • Understanding penalty term behavior is key to improving machine learning model efficiency.