* initial commit * update tuner/utils.py * update ACKNOWLEDGMENTS.md * update * nits * movinf mamba2 cache over to cache.py + clean up * clean up * fix residual_in_fp32 * updates * adding default args * updates * first working inference with codestral mamba * clean up * adding 1b mamba 2 * udpdates * updates * updates * finish * clean up * clean ups * format * nits * adding some einsums * format again * optimize + format * nits * nits * more speed * use custom kernel * update * format * nits --------- Co-authored-by: Awni Hannun <[email protected]>
1.5 KiB
1.5 KiB
Individual Contributors
If you wish to be acknowledged for your contributions, please list your name with a short description of your contribution(s) below. For example:
- Jane Smith: Added the
fooexample.
MLX LM was developed with contributions from the following individuals:
- Shunta Saito: Added support for PLaMo models.
- Gökdeniz Gülmez: Added support for the following architectures: OpenBMB's
MiniCPMandMiniCPM3, Kyutai'sHelium, State-Space'sMamba v1,Mamba v2, Z.ai & THUKEG'sGLM,GLM4, Rednotedots.llm1, Baisu'sErnie4.5 MoE, inclusionAI'sBailing MoE e.g. Ling-family, Klear team - Kuaishou Technology'sKlear, IBM'sGranite MoE, Meituan'sLongCat, Nvidia'sNemotron H, Swiss-AI'sApertus, Nikity'sLille130m, Alibaba Qwen'sQwen3Next, and Allenai'sOLMoE; Helped add support for the following model architectures: Alibaba Qwen'sQwen3 & Qwen3MoE); Added support for the following training algorithms:Full Weight Fine-Tuning, and theMuonoptimizer; Added support for the following other features:Multiple Optimizers to choose for training, andreporting training metrics to WandB (Weights & Biases). - Prince Canuma: Helped add support for the following model architectures:
HuggingFace's
Starcoder2, Cohere'sCohere (1 and 2), Alibaba Qwen'sQwen (2, 3 and MoE), Microsoft'sPhi (3 and 3.5 MoE),BitNet1.58, Meta'sLlama (3 and 4), Google DeepMind'sGemma 3, and InterLM'sInternLM 2.5.