Files

T

90e33f5443 Adding bailing_moe (ling-lite, -plus, -coder) (#369 )

* initial commit

* update ackn.

* update ackn.

* using linear in gate class and adding to lora

* making it trainable

* format

* format again

* format + remove commetns

* add copyright

* nits

---------

Co-authored-by: Awni Hannun <[email protected]>

2025-08-14 07:54:59 -07:00

1.2 KiB

Raw Permalink Blame History

Individual Contributors

If you wish to be acknowledged for your contributions, please list your name with a short description of your contribution(s) below. For example:

Jane Smith: Added the foo example.

MLX LM was developed with contributions from the following individuals:

Shunta Saito: Added support for PLaMo models.
Gökdeniz Gülmez: Added support for the following architectures: OpenBMB's MiniCPM and MiniCPM3, Kyutai's Helium, State-Space'sMamba v1, Z.ai & THUKEG's GLM4, Rednote dots.llm1, Baisu's Ernie4.5 MoE, inclusionAI's Ling-lite, Ling-Coder-lite, Ling-plus, and Allenai's OLMoE; Added support for the following training algorithms: Full Weight Fine-Tuning, and the Muon optimizer; Added support for the following other features: Multiple Optimizers to choose for training, and reporting training metrics to WandB (Weights & Biases).
Prince Canuma: Helped add support for the following model architectures: HuggingFace's Starcoder2, Cohere's Cohere (1 and 2), Alibaba Qwen's Qwen (2, 3 and MoE), Microsoft's Phi (3 and 3.5 MoE), BitNet1.58, Meta's Llama (3 and 4), Google DeepMind's Gemma 3, and InterLM's InternLM 2.5.

1.2 KiB Raw Permalink Blame History

Individual Contributors

1.2 KiB

Raw Permalink Blame History