luz_callback_gradient_clip: Gradient clipping callback
In mlverse/luz: Higher Level 'API' for 'torch'
luz_callback_gradient_clip R Documentation
Gradient clipping callback
Description
By adding the GradientClip callback, the gradient norm_type (default:2) norm
is clipped to at most max_norm (default:1) using torch::nn_utils_clip_grad_norm_(),
which can avoid loss divergence.
Usage
luz_callback_gradient_clip(max_norm = 1, norm_type = 2)
Arguments
max_norm
(float or int): max norm of the gradients
norm_type
(float or int): type of the used p-norm. Can be Inf for
infinity norm.
References
See FastAI documentation
for the GradientClip callback.
mlverse/luz documentation built on Sept. 19, 2024, 11:20 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| luz_callback_gradient_clip | R Documentation |
Gradient clipping callback
Description
By adding the GradientClip callback, the gradient norm_type (default:2) norm
is clipped to at most max_norm (default:1) using torch::nn_utils_clip_grad_norm_(),
which can avoid loss divergence.
Usage
luz_callback_gradient_clip(max_norm = 1, norm_type = 2)
Arguments
max_norm |
(float or int): max norm of the gradients |
norm_type |
(float or int): type of the used p-norm. Can be |
References
See FastAI documentation for the GradientClip callback.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.