The function calculates the activation of the units and returns a list, in which the first entry is the rectified linear activation of the units and the second entry is the derivative of the transfer function.
Input for the activation function.
Additional parameters, not used.
A list with the rectified linear activation in the first entry and the derivative of the activation in the second entry.
Glorot, Xavier, Antoine Bordes, and Yoshua Bengio (2011). "Deep Sparse Rectifier Neural Networks". In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11). Ed. by Geoffrey J. Gordon and David B. Dunson. Vol. 15. Journal of Machine Learning Research - Workshop and Conference Proceedings, pp. 315-323. URL : http://www.jmlr.org/proceedings/papers/v15/glorot11a/glorot11a.pdf
1 2 3 4 5
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.