skip to main content
Primo Search
Search in: Busca Geral
Tipo de recurso Mostra resultados com: Mostra resultados com: Índice

Bi-modal derivative activation function for sigmoidal feedforward networks

Singh Sodhi, Sartaj ; Chandra, Pravin

Neurocomputing (Amsterdam), 2014-11, Vol.143, p.182-196 [Periódico revisado por pares]

Amsterdam: Elsevier B.V

Texto completo disponível

Citações Citado por
  • Título:
    Bi-modal derivative activation function for sigmoidal feedforward networks
  • Autor: Singh Sodhi, Sartaj ; Chandra, Pravin
  • Assuntos: Activation function ; Applied sciences ; Artificial intelligence ; Bi-modal activation function ; Computer science; control theory; systems ; Connectionism. Neural networks ; Exact sciences and technology ; Learning and adaptive systems ; Sigmoidal feed-forward artificial neural network ; Sigmoidal function class
  • É parte de: Neurocomputing (Amsterdam), 2014-11, Vol.143, p.182-196
  • Descrição: A new class of activation functions is proposed as the sum of shifted log-sigmoid activation functions. This has the effect of making the derivative of the activation function with respect to the net inputs, be bi-modal. That is, the derivative of the activation functions has two maxima of equal values for nonzero values of the parameter, that parametrises the proposed class of activation functions. On a set of ten function approximation tasks, the usage of the proposed activation function demonstrates that there exists network(s), using the proposed activation, and are able to achieve lower generalisation error, in equal epochs of training using the resilient backpropagation algorithm. On a set of four benchmark problems taken from UCI machine learning repository, for which the networks are trained using the resilient backpropagation algorithm, the scaled conjugate algorithm, the Levenberg–Marquardt algorithm and the quasi-Newton BFGS algorithm, we observe that the usage of the proposed algorithms leads to better generalisation results, similar to the results for the ten function approximation tasks wherein the networks were trained using the resilient backpropagation algorithm.
  • Editor: Amsterdam: Elsevier B.V
  • Idioma: Inglês

Buscando em bases de dados remotas. Favor aguardar.