 n8programs
|
1423702019
|
Update glm4_moe_lite To Store KV Latent in Cache (#780)
* update glm4_moe_lite
* Fix GLM4 MoE Lite RoPE and MoE layer selection
* Apply PR #780 MLA KV latent cache
* Use full KV for prefill with MLA cache
* Remove unused GLM4 MoE lite config fields
* simplify
* updates
* try and load already quantized models
---------
Co-authored-by: N8 <n8@n8programs.com>
Co-authored-by: ivanfioravanti <ivan.fioravanti@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>
|
2026-01-21 13:55:14 -08:00 |
|