ReLU¶

class dragon.vm.caffe.core.layers.ReLU(layer_param)[source]¶

Apply the rectified linear unit. [Nair & Hinton, 2010].

The ReLU function is defined as:

\[\text{ReLU}(x) = \begin{cases} x, & \text{ if } x \geq 0 \\ 0, & \text{ otherwise } \end{cases} \]

Examples:

layer {
  type: "ReLU"
  bottom: "conv2"
  top: "conv2/relu"
  relu_param {
    negative_slope: 0.
  }
}