From f90029e3c313fbef043df7f60accb009447d78a3 Mon Sep 17 00:00:00 2001 From: DandinPower Date: Mon, 3 Nov 2025 19:44:38 +0800 Subject: [PATCH] doc: update doc for q2_k --- CHANGES.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/CHANGES.md b/CHANGES.md index abb6100c..cceffd14 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -258,6 +258,7 @@ A new CLI argument (`--comm_datatype TYPE`) sets the communication data type. Su - f32 (default, no compression) - q8_0 (8-bit block quantization) - q4_0 (4-bit block quantization) +- q2_k (2-bit k quantization) - f32_sparsity (no quantization, but allows `--comm_sparse_percentage` to select the top-k features for each token based on the specified sparsity percentage) ### Communication Logic @@ -265,7 +266,7 @@ A new CLI argument (`--comm_datatype TYPE`) sets the communication data type. Su - **Send path** - If `f32`, tensors are transmitted directly. - - If `q8_0` or `q4_0`, tensors are quantized before transmission. + - If `q8_0`, `q4_0` or `q2_k`, tensors are quantized before transmission. - If `f32_sparsity`, tensors are pruned before transmission. - **Receive path**