mx.nd.mp.sgd.update
¶
Description¶
Updater function for multi-precision sgd optimizer
Arguments¶
Argument |
Description |
---|---|
|
NDArray-or-Symbol. Weight |
|
NDArray-or-Symbol gradient |
|
NDArray-or-Symbol. Weight32 |
|
float, required. Learning rate |
|
float, optional, default=0. Weight decay augments the objective function with a regularization term that penalizes large weights. The penalty scales with the square of the magnitude of each weight. |
|
float, optional, default=1. Rescale gradient to grad = rescale_grad*grad. |
|
float, optional, default=-1. Clip gradient to the range of [-clip_gradient, clip_gradient] If clip_gradient <= 0, gradient clipping is turned off. grad = max(min(grad, clip_gradient), -clip_gradient). |
|
boolean, optional, default=1. If true, lazy updates are applied if gradient’s stype is row_sparse. |
Value¶
out
The result mx.ndarray