n8programs
1423702019
* update glm4_moe_lite * Fix GLM4 MoE Lite RoPE and MoE layer selection * Apply PR #780 MLA KV latent cache * Use full KV for prefill with MLA cache * Remove unused GLM4 MoE lite config fields * simplify * updates * try and load already quantized models --------- Co-authored-by: N8 <n8@n8programs.com> Co-authored-by: ivanfioravanti <ivan.fioravanti@gmail.com> Co-authored-by: Awni Hannun <awni@apple.com>