scitex_ml.optim.Ranger_Deep_Learning_Optimizer.ranger.ranger2020

Functions

centralized_gradient(x[, use_gc, gc_conv_only])

credit - https://github.com/Yonghongwei/Gradient-Centralization

Classes

Ranger(*args, **kwargs)

scitex_ml.optim.Ranger_Deep_Learning_Optimizer.ranger.ranger2020.centralized_gradient(x, use_gc=True, gc_conv_only=False)

credit - https://github.com/Yonghongwei/Gradient-Centralization

class scitex_ml.optim.Ranger_Deep_Learning_Optimizer.ranger.ranger2020.Ranger(*args: Any, **kwargs: Any)

__init__(params, lr=0.001, alpha=0.5, k=6, N_sma_threshhold=5, betas=(0.95, 0.999), eps=1e-05, weight_decay=0, use_gc=True, gc_conv_only=False, gc_loc=True)

step(closure=None)