Adding Relu2 (#2582)

* in. com.

* upd. ackn.

* update __init__

* nits

* nits + format

* used mx.maximum(x, 0) instead of calling the function and moves relu6 under relu2 to make it nicer

* same with _make_activation_module

* Update python/mlx/nn/layers/activations.py

upd

Co-authored-by: Awni Hannun <[email protected]>

* update funct.rst

* upd. layers.rst

---------

Co-authored-by: Awni Hannun <[email protected]>
This commit is contained in:
Gökdeniz Gülmez
2025-09-10 07:24:30 -07:00
committed by GitHub
co-authored by Awni Hannun
parent 52b8384d10
commit db5443e831
5 changed files with 39 additions and 18 deletions
+1
View File
@@ -27,6 +27,7 @@ simple functions.
mish
prelu
relu
relu2
relu6
selu
sigmoid