generateWeightsHeNormal: He normal weight initialization

Description Usage Arguments Value References See Also Examples

Description

This function is used to generate random weights and biases using He normal weight initialization as described in He et al., http://arxiv.org/abs/1502.01852.

Usage

1
2
generateWeightsHeNormal(numUnits1, numUnits2,
  weights.mean = getParameter(".weights.mean", 0, ...), ...)

Arguments

numUnits1

Number of units in the lower layer.

numUnits2

Number of units in the upper layer.

weights.mean

mean parameter to the rnorm function.

...

Additional parameters, used for parameter resolution and passed to generateWeightsNormal.

Value

Weight matrix.

References

He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun (2015). "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification". In: CoRR abs/1502.01852. URL: http://arxiv.org/abs/1502.01852

See Also

Other weight generation functions: generateWeightsGlorotNormal, generateWeightsGlorotUniform, generateWeightsHeUniform, generateWeightsNormal, generateWeightsUniform

Examples

1
2
3
4
5
6
## Not run: 
data(iris)
model <- darch(Species ~ ., iris, generateWeightsFunction = "generateWeightsHeNormal",
 weights.mean = .1)

## End(Not run)


Search within the darch package
Search all R packages, documentation and source code

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.