Related Experiment Videos
Generalized hidden-mapping ridge regression, knowledge-leveraged inductive transfer learning for neural networks,
IEEE Transactions on Cybernetics
|April 9, 2014
Summary
This study introduces Transfer Generalized Hidden-Mapping Ridge Regression (TGHRR), a novel inductive transfer learning method. TGHRR effectively trains diverse models by leveraging source domain knowledge, outperforming existing algorithms in regression and classification tasks.
Area of Science:
- Machine Learning
- Artificial Intelligence
- Data Science
Background:
- Inductive transfer learning leverages source domain data to improve target domain model training.
- Existing transfer learning methods are often model-specific, limiting their applicability.
- A need exists for flexible transfer learning approaches applicable to various classical intelligence models.
Purpose of the Study:
- To introduce a generalized transfer learning method applicable to diverse models.
- To develop an inductive transfer learning algorithm integrating knowledge leverage with GHRR.
- To evaluate the performance of the proposed TGHRR method.
Main Methods:
- Generalized Hidden-Mapping Ridge Regression (GHRR) was developed for training various models.
- A knowledge-leverage based transfer learning mechanism was integrated with GHRR, creating TGHRR.
- TGHRR utilizes induced knowledge for clearer and more concise data distribution control.
Main Results:
- Experimental evaluation included regression and classification on synthetic and real-world datasets.
- The proposed GHRR and TGHRR algorithms demonstrated effectiveness.
- TGHRR performance was competitive with or superior to state-of-the-art inductive transfer learning algorithms.
Conclusions:
- TGHRR offers a flexible and effective inductive transfer learning solution.
- The method successfully leverages source domain knowledge for improved target domain model performance.
- TGHRR provides a viable alternative to model-specific transfer learning techniques.
Related Concept Videos
Multi-input and Multi-variable systems
544
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
544
Application of Linearization and Approximation
193
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
193
Linearization and Approximation
233
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
233
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
438
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
438
Classification of Systems-I
742
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
742