dragon.optimizers¶
Classes¶
class Adam : The optimizer to apply Adam algorithm. [Kingma & Ba, 2014].
class AdamW : The optimizer to apply AdamW algorithm. [Loshchilov & Hutter, 2017].
class RMSProp : The optimizer to apply RMSprop algorithm. [Hinton et.al, 2013].
class SGD : The optimizer to apply SGD algorithm. [Polyak, 1964].