PReLU

class dragon.vm.caffe.layers.PReLU(layer_param)[source]

Apply the parametric rectified linear unit. [He et.al, 2015].

The PReLU function is defined as:

\[\text{PReLU}(x) = \begin{cases} x, & \text{ if } x \geq 0 \\ weight * x, & \text{ otherwise } \end{cases} Examples:\]

Examples:

layer {
    type: "PReLU"
    bottom: "conv2"
    top: "conv2/relu"
    prelu_param {
        channel_shared: false
        filler {
            type: "constant"
            value: 0.25
        }
    }
}