Files

T

Gökdeniz Gülmez 854b427fb9 Adding ernie4.5 moe (#267 )

* initial commit

* loading and quant works

* inference works

* udpate ackn.

* use switch_layers

* sumarize sanitize and remove torch version

* formating

* clean ups

* add default parameter

* fixes

* nits

* nits

---------

Co-authored-by: Awni Hannun <awni@apple.com>

2025-07-04 17:13:13 -07:00

1.1 KiB

Raw Permalink Blame History

Individual Contributors

If you wish to be acknowledged for your contributions, please list your name with a short description of your contribution(s) below. For example:

Jane Smith: Added the foo example.

MLX LM was developed with contributions from the following individuals:

Shunta Saito: Added support for PLaMo models.
Gökdeniz Gülmez: Added support for the following architectures: OpenBMB's MiniCPM and MiniCPM3, Kyutai's Helium, State-Space'sMamba v1, Z.ai & THUKEG's GLM4, Rednote dots.llm1, Baisu's Ernie4.5 MoE, and Allenai's OLMoE; Added support for the following training algorithms: full-fine-tuning; Added support for the following other features: Multiple Optimizers to choose for training, and reporting training metrics to WandB (Weights & Biases).
Prince Canuma: Helped add support for the following model architectures: HuggingFace's Starcoder2, Cohere's Cohere (1 and 2), Alibaba Qwen's Qwen (2, 3 and MoE), Microsoft's Phi (3 and 3.5 MoE), BitNet1.58, Meta's Llama (3 and 4), Google DeepMind's Gemma 3, and InterLM's InternLM 2.5.

1.1 KiB Raw Permalink Blame History

Individual Contributors

1.1 KiB

Raw Permalink Blame History