1.
F. Agostinelli, M. Hoffman, P. Sadowski and P. Baldi, Learning activation functions to improve deep neural networks, (2015), arXiv: 1412.6830.
2. A survey on modern trainable activation functions
3.
J. T. Barron, Squareplus: A softplus-like algebraic rectifier, (2021) arXiv: 2112.11687.
4.
I. Berngardt, Improving classification neural networks by using absolute activation function(MNIST/LeNET-5example), (2023), arXiv: 2304.11758.
5.
G. J. Bingham, Optimizing neural networks through activation function discovery and automatic weight initialization, PhD Dissertation, The University of Teas at Austin, (2023).