batch_decay: Batch/checkpoint decay helper

In ngme2: Linear Latent Non-Gaussian Models with Flexible Distributions

Batch/checkpoint decay helper

Description

Batch/checkpoint decay helper

Usage

batch_decay(
  patience = 3,
  gamma = 0.5,
  min_delta = 0,
  warmup = 0,
  min_stepsize = 0
)

Arguments

patience	number of consecutive checkpoints without improvement before decay.
gamma	decay factor in (0,1).
min_delta	minimum required decrease to count as improvement.
warmup	number of initial checkpoints to skip.
min_stepsize	lower bound for absolute stepsize.

Details

Convenience helper that enables grad-norm plateau decay and keeps iteration schedule constant.

Value

a stepsize_control() object.

ngme2 documentation built on May 20, 2026, 9:10 a.m.