 DandinPower
|
73969b44b1
|
feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)
|
2025-12-06 21:08:10 +08:00 |
|