Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Superposition Theorem

Superposition Theorem

The superposition principle is a fundamental concept stating that in a linear circuit, the voltage across (or current through) an element can be determined by summing the individual contributions of each independent source acting in isolation. When dealing with linear circuits containing multiple independent sources, this principle serves as a valuable tool for analysis. To apply the superposition principle effectively, one should focus on a single independent source at a time while...

Method of Superposition

Method of Superposition

The method of superposition is a crucial technique in structural engineering, used to analyze the effect of multiple loads on beams. This approach involves calculating the deflection and slope for each load on a beam separately, and then summing these effects to determine the overall impact. It is applicable only when the beam material remains within its elastic limit, ensuring that deformations are linearly elastic.
When applying the method of superposition, each type of load—whether...

Classification of Systems-II

Classification of Systems-II

Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,

Classification of Systems-I

Classification of Systems-I

Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:

Classification of Signals

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

The Power Superposition Principle

The Power Superposition Principle

Consider a circuit with two sinusoidal voltage sources. Each one influences the circuit independently, and the superposition principle helps us understand the combined effect by adding up the responses from each source.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Predicting vasovagal syncope during head-up tilt test: three machine learning approaches.

Frontiers in neuroinformatics·2026

Same author

Economic burden of heart failure in Europe: A systematic review of costs and cost-effectiveness.

ESC heart failure·2025

Same author

Machine Learning-Assisted Secure Random Communication System.

Entropy (Basel, Switzerland)·2025

Same author

Clinical validation of an artificial intelligence-based decision support system for diagnosis and risk stratification of heart failure (STRATIFYHF): a protocol for a prospective, multicentre longitudinal study.

BMJ open·2025

Same author

Nephila spider male aggregation: preference for optimal female size and web clustering.

Integrative zoology·2024

Same author

Analysis of neuropsychological and neuroradiological features for diagnosis of Alzheimer's disease and mild cognitive impairment.

International journal of medical informatics·2023

Search research articles

Related Experiment Video

Updated: Aug 9, 2025

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

SuperFormer: Continual learning superposition method for text classification.

Marko Zeman¹, Jana Faganeli Pucer¹, Igor Kononenko¹

¹University of Ljubljana, Faculty of Computer and Information Science, Slovenia.

Neural Networks : the Official Journal of the International Neural Network Society

|February 22, 2023

Summary

SuperFormer combats machine learning model forgetting in continual learning without extra memory or training time. This novel method significantly reduces training duration while maintaining high performance on text classification tasks.

Keywords:

Continual learning Deep learning Superposition Transformers

More Related Videos

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Aug 9, 2025

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Artificial Intelligence
Machine Learning
Deep Learning

Background:

Continual learning models struggle with catastrophic forgetting, losing previously learned information.
Existing solutions often require substantial memory and increase training time significantly.

Purpose of the Study:

To introduce SuperFormer, a novel method to alleviate model forgetting in sequential task learning.
To achieve this with negligible additional memory and training time.

Main Methods:

SuperFormer addresses continual learning challenges in a sequential task learning scenario.
The method was compared against prominent continual learning techniques like EWC, SI, MAS, GEM, and PSP.

Main Results:

SuperFormer achieved superior average performance in AUROC (0.7% gain) and AUPRC (0.9% gain).
It demonstrated the lowest training time, reducing it by a factor of 5.4-8.5 compared to similar methods.
The method's memory footprint is comparable to the most memory-efficient approaches.

Conclusions:

SuperFormer effectively mitigates catastrophic forgetting in continual learning.
The proposed method offers a highly efficient solution in terms of both training time and memory usage.