Swish vs ReLU — Why Swish Works So Well

Three ReLU networks with different widths learning noisy step(x)

ReLU Isn’t Always the Best Choice

ReLU vs Leaky ReLU vs ELU Explained Simply

Three ReLU networks with different widths learning sign(sin⁡(x))

Three ReLU networks with different widths learning noisy sin

Understanding Activation Functions: ReLU, Leaky ReLU and Randomized Leaky ReLU

Machine Learning Crash Course: The Optimistic ReLU Function

ReLU vs Leaky ReLU Explained