dragon.optimizers¶

Classes¶

class Adam : The optimizer to apply Adam algorithm. [Kingma & Ba, 2014].

class Nesterov : The optimizer to apply NesterovSGD algorithm. [Sutskever et.al, 2013].

class RMSProp : The optimizer to apply RMSprop algorithm. [Hinton et.al, 2013].

class SGD : The optimizer to apply MomentumSGD algorithm. [Polyak, 1964].