weightDecayWeightUpdate: Updates the weight using weight decay.

In darch: Package for Deep Architectures and Restricted Boltzmann Machines

Description

Multiplies the weights by (1 - weightDecay) before applying the scheduled weight changes.

Usage

weightDecayWeightUpdate(darch, layerIndex, weightsInc, biasesInc, ...,
  weightDecay = getParameter(".darch.weightDecay", 0, darch),
  debug = getParameter(".debug", F, darch))

Arguments

darch	DArch instance.
layerIndex	Layer index within the network.
weightsInc	Matrix containing scheduled weight updates from the fine-tuning algorithm.
biasesInc	Bias weight updates.
...	Additional parameters, not used.
weightDecay	Weights are multiplied by (1 - weightDecay) before each update. Corresponds to the darch.weightDecay parameter of darch.default.
debug	Internal debugging flag.

Value

updated weights

See Also

Other weight update functions: maxoutWeightUpdate

Examples

## Not run: 
model <- darch(Species ~ ., iris, c(0, 50, 0),
 darch.weightUpdateFunction = "weightDecayWeightUpdate")

## End(Not run)

darch documentation built on May 29, 2017, 8:14 p.m.