ELU

class dragon.vm.caffe.core.layers.ELU(layer_param)[source]

Apply the exponential linear unit. [Clevert et.al, 2015].

The ELU function is defined as:

\[\text{ELU}(x) = \begin{cases} x, & \text{ if } x \geq 0 \\ \alpha * (\exp(x) - 1), & \text{ otherwise } \end{cases} \]

Examples:

layer {
  type: "ELU"
  bottom: "conv2"
  top: "conv2"
  elu_param {
    alpha: 1.
  }
}