Adding Relu2 (#2582)

* in. com.

* upd. ackn.

* update __init__

* nits

* nits + format

* used mx.maximum(x, 0) instead of calling the function and moves relu6 under relu2 to make it nicer

* same with _make_activation_module

* Update python/mlx/nn/layers/activations.py

upd

Co-authored-by: Awni Hannun <[email protected]>

* update funct.rst

* upd. layers.rst

---------

Co-authored-by: Awni Hannun <[email protected]>

This commit is contained in:

Gökdeniz Gülmez

2025-09-10 07:24:30 -07:00

committed by

GitHub

co-authored by

Awni Hannun

parent 52b8384d10

commit db5443e831

5 changed files with 39 additions and 18 deletions

									
										docs/src/python/nn/layers.rst
									
		+1
		
												View File
												
				@@ -50,6 +50,7 @@ Layers

				   QuantizedLinear

				   RMSNorm

				   ReLU

				   ReLU2

				   ReLU6

				   RNN

				   RoPE