ELU

class dragon.vm.caffe.layers.ELU(layer_param)[source]

Apply the exponential linear unit. [Clevert et.al, 2015].

The ELU function is defined as:

\[\text{ELU}(x) = \begin{cases} x, & \text{ if } x \geq 0 \\ \alpha * (e^{x} - 1), & \text{ otherwise } \end{cases} \]

Examples:

layer {
    type: "ELU"
    bottom: "conv2"
    top: "conv2"
    elu_param {
        alpha: 1.
    }
}