dragon.optimizers¶

Classes¶

class Adam : The optimizer to apply Adam algorithm. [Kingma & Ba, 2014].

class AdamW : The optimizer to apply AdamW algorithm. [Loshchilov & Hutter, 2017].

class Nesterov : The optimizer to apply NesterovSGD algorithm. [Sutskever et.al, 2013].

class RMSProp : The optimizer to apply RMSprop algorithm. [Hinton et.al, 2013].

class SGD : The optimizer to apply MomentumSGD algorithm. [Polyak, 1964].