nn_init_orthogonal_: Orthogonal initialization

In torch: Tensors and Neural Networks with 'GPU' Acceleration

Orthogonal initialization

Description

Fills the input Tensor with a (semi) orthogonal matrix, as described in ⁠Exact solutions to the nonlinear dynamics of learning in deep linear neural networks⁠ - Saxe, A. et al. (2013). The input tensor must have at least 2 dimensions, and for tensors with more than 2 dimensions the trailing dimensions are flattened.

Usage

nn_init_orthogonal_(tensor, gain = 1)

Arguments

tensor	an n-dimensional Tensor
gain	optional scaling factor

Examples

if (torch_is_installed()) {
w <- torch_empty(3, 5)
nn_init_orthogonal_(w)
}

torch documentation built on May 29, 2024, 9:54 a.m.