Update comment for AdamW implementation reference. (#4604)

Co-authored-by: Will Findley <[email protected]>
2023-12-26 11:42:08 +01:00
parent 77465dad48
commit de8e496437
1 changed files with 2 additions and 2 deletions
@@ -17456,9 +17456,9 @@ static void ggml_opt_acc_grad(int np, struct ggml_tensor * const ps[], float * g
 }

 //
-// ADAM
+// Using AdamW - ref: https://arxiv.org/pdf/1711.05101v3.pdf
 //
-//   ref: https://arxiv.org/pdf/1412.6980.pdf
+// (Original Adam - ref: https://arxiv.org/pdf/1412.6980.pdf)
 //

 static enum ggml_opt_result ggml_opt_adam(