Add Lion optimizer (#209)

* Add Lion optimizer * Update acknowledgements also with past contributions
2023-12-20 22:54:58 +01:00
parent f40d17047d
commit 4912ff3ec2
3 changed files with 59 additions and 1 deletions
@@ -44,3 +44,4 @@ model's parameters and the **optimizer state**.
   Adam
   AdamW
   Adamax
+   Lion