layer_norm¶

dragon.vm.torch.nn.functional.layer_norm(
  input,
  normalized_shape,
  weight,
  bias,
  eps=1e-05
)[source]¶

Apply the layer normalization to input. [Ba et.al, 2016]

Parameters:

• input (dragon.vm.torch.Tensor) – The input tensor.
• normalized_shape (Sequence[int]) – The size normalized over the last dimensions.
• weight (dragon.vm.torch.Tensor) – The weight tensor.
• bias (dragon.vm.torch.Tensor) – The bias tensor.
• eps (float, optional, default=1e-5) – The epsilon value.

Returns:

dragon.vm.torch.Tensor – The output tensor.

See also

torch.nn.LayerNorm(…)