lr_cosine_annealing: Set the learning rate of each parameter group using a cosine...

In torch: Tensors and Neural Networks with 'GPU' Acceleration

Set the learning rate of each parameter group using a cosine annealing schedule

Description

Set the learning rate of each parameter group using a cosine annealing schedule

Usage

lr_cosine_annealing(
  optimizer,
  T_max,
  eta_min = 0,
  last_epoch = -1,
  verbose = FALSE
)

Arguments

optimizer	(Optimizer): Wrapped optimizer.
T_max	Maximum number of iterations
eta_min	Minimum learning rate. Default: 0.
last_epoch	The index of the last epoch
verbose	(bool): If TRUE, prints a message to stdout for each update. Default: FALSE.

torch documentation built on May 29, 2024, 9:54 a.m.