818cda16bc
* Add a few LR schedulers * Move parents's constructor call to the top * Fix docstring * refactor optimizers into two files * add docs * nit * Fix Callable type annotation for python 3.8 --------- Co-authored-by: Awni Hannun <awni@apple.com> Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com>
21 lines
267 B
ReStructuredText
21 lines
267 B
ReStructuredText
.. _common_optimizers:
|
|
|
|
Common Optimizers
|
|
=================
|
|
|
|
.. currentmodule:: mlx.optimizers
|
|
|
|
.. autosummary::
|
|
:toctree: _autosummary
|
|
:template: optimizers-template.rst
|
|
|
|
SGD
|
|
RMSprop
|
|
Adagrad
|
|
Adafactor
|
|
AdaDelta
|
|
Adam
|
|
AdamW
|
|
Adamax
|
|
Lion
|