DandinPower 73969b44b1 feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)

2025-12-06 21:08:10 +08:00

..

bitsqueeze.h

feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)

2025-12-06 21:08:10 +08:00

llama.h

feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)

2025-12-06 21:08:10 +08:00

zmq_addon.hpp

init

2024-10-23 09:42:32 +04:00

zmq.hpp

add noreturn flag for monitor

2025-01-07 20:38:11 +04:00