dragon.optimizers¶

Classes¶

class Adam : The optimizer to apply Adam algorithm. [Kingma & Ba, 2014].

class AdamW : The optimizer to apply AdamW algorithm. [Loshchilov & Hutter, 2017].

class RMSProp : The optimizer to apply RMSprop algorithm. [Hinton et.al, 2013].

class SGD : The optimizer to apply SGD algorithm. [Polyak, 1964].