PReLU

class dragon.vm.caffe.core.layers.PReLU(layer_param)[source]

Apply the parametric rectified linear unit. [He et.al, 2015].

The PReLU function is defined as:

\[\text{PReLU}(x) = \begin{cases} x, & \text{ if } x \geq 0 \\ weight * x, & \text{ otherwise } \end{cases} Examples:\]

Examples:

layer {
  type: "PReLU"
  bottom: "conv2"
  top: "conv2/relu"
  prelu_param {
    channel_shared: false
    filler {
      type: "constant"
      value: 0.25
    }
  }
}