A Neural Network Approximation Based on a Parametric Sigmoidal Function

Citations Over TimeTop 17% of 2019 papers

Abstract

It is well known that feed-forward neural networks can be used for approximation to functions based on an appropriate activation function. In this paper, employing a new sigmoidal function with a parameter for an activation function, we consider a constructive feed-forward neural network approximation on a closed interval. The developed approximation method takes a simple form of a superposition of the parametric sigmoidal function. It is shown that the proposed method is very effective in approximation of discontinuous functions as well as continuous ones. For some examples, the availability of the presented method is demonstrated by comparing its numerical results with those of an existing neural network approximation method. Furthermore, the efficiency of the method in extended application to the multivariate function is also illustrated.

Related Papers

• → The generalized sigmoid activation function: Competitive supervised learning(1997)220 cited
• → Weighted sigmoid gate unit for an activation function of deep neural network(2020)52 cited
• → A skewed derivative activation function for SFFANNs(2014)8 cited
• → A Novel Activation Function in Convolutional Neural Network for Image Classification in Deep Learning(2020)2 cited
• → Evaluation of Sigmoid and ReLU Activation Functions Using Asymptotic Method(2022)