A novel type of activation function in artificial neural networks: Trained activation function.

Ömer Faruk Ertuğrul1

  • 1Department of Electrical and Electronics Engineering, Batman University, 72060 Batman, Turkey.

Summary

This study introduces a novel trained activation function for artificial neural networks (ANNs). This method optimizes activation functions per neuron, outperforming traditional trial-and-error tuning for improved ANNs success rates.

Related Concept Videos

Types of Functions I01:26

Types of Functions I

Functions are fundamental mathematical tools that capture relationships between variables and describe how one quantity changes in relation to another. Their diverse forms allow them to model various real-world phenomena with precision and flexibility. Among the various categories, algebraic functions are prominent due to their formulation through basic arithmetic operations: addition, subtraction, multiplication, division, and root extraction.Algebraic functions include polynomial, rational,...
319
Network Function of a Circuit01:25

Network Function of a Circuit

Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
889
Types of Functions II01:19

Types of Functions II

Trigonometric and exponential functions are essential mathematical tools used to model distinct types of real-world behavior, particularly in periodic and growth-related phenomena. These functions extend the capabilities of basic algebraic models by capturing recurring cycles and rapid changes across various scientific and engineering contexts.Trigonometric functions, such as sine and cosine, are particularly effective for representing periodic phenomena. Their cyclic behavior makes them...
207
Types of Functions III01:28

Types of Functions III

Logarithmic and piecewise functions play central roles in mathematical modeling, particularly when capturing nonlinear or segmented behaviors in real-world phenomena. Although these functions differ fundamentally in structure and application, both serve to represent complex relationships in simplified mathematical terms.A logarithmic function is defined as the inverse of an exponential function, expressed as These functions grow quickly for small values of x but slow down as x increases,...
273
T Cell Types and Functions01:24

T Cell Types and Functions

When T cells with CD4 markers are activated, they give rise to two types of effector cells: helper T cells and regulatory T cells. Meanwhile, T cells with CD8 markers differentiate into effector cytotoxic T cells. The differentiation of CD4 T cells into helper T cell subsets, such as Th1, Th2, and Th17 cells, is dependent on the antigen type, antigen-presenting cell, and regulatory cytokines.
Th1 cells stimulate dendritic cells to express necessary co-stimulatory molecules on their surfaces for...
2.7K
Co-activators and Co-repressors02:04

Co-activators and Co-repressors

Gene transcription is regulated by the synergistic action of several proteins that form a complex at a gene regulatory site. This is observed in eukaryotes, where the regulation of gene expression is a complex process. Regulatory proteins in eukaryotes can broadly be classified into two types – regulators that bind directly to specific DNA sequences and co-regulators that associate with regulatory proteins but cannot directly bind to the DNA. These co-regulators are further divided into...
8.7K