DandinPower 9e1a4f2942 feat: first draft of q2_k quantization support

2025-11-03 18:24:41 +08:00

..

fp16

feat: first draft of q2_k quantization support

2025-11-03 18:24:41 +08:00

CMakeLists.txt

llama : move vocab, grammar and sampling into separate files (#8508)

2024-07-23 13:10:17 +03:00

k_quantization.cpp

feat: first draft of q2_k quantization support

2025-11-03 18:24:41 +08:00

k_quantization.h

feat: first draft of q2_k quantization support

2025-11-03 18:24:41 +08:00

llama-grammar.cpp

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

llama-grammar.h

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

llama-impl.h

log : add CONT level for continuing previous log entry (#9610)

2024-09-24 10:15:35 +03:00

llama-sampling.cpp

sampling : avoid expensive softmax during greedy sampling (#9605)

2024-09-24 09:03:17 +03:00

llama-sampling.h

llama : refactor samplers internal implementation (#9370)

2024-09-08 15:52:07 +02:00

llama-vocab.cpp

llama : add reranking support (#9510)

2024-09-28 17:42:03 +03:00

llama-vocab.h

rerank : use [SEP] token instead of [BOS] (#9737)

2024-10-05 15:55:04 +03:00

llama.cpp

feat: first draft of q2_k quantization support

2025-11-03 18:24:41 +08:00

network-utils.cpp

fix: replace localhost to 127.0.0.1

2025-06-17 11:27:58 +08:00

network-utils.h

fix: replace localhost to 127.0.0.1

2025-06-17 11:27:58 +08:00

quantization.cpp

feat: refactor and fix bug for q8_0 and can easily support q4_0 and fp32 in future

2025-08-23 12:46:26 +00:00

quantization.h

feat: refactor and fix bug for q8_0 and can easily support q4_0 and fp32 in future

2025-08-23 12:46:26 +00:00

sparsity.cpp

feat: first draft of f32 sparsity support

2025-10-06 10:00:50 +08:00

sparsity.h

feat: first draft of f32 sparsity support

2025-10-06 10:00:50 +08:00

unicode-data.cpp

llama : reduce compile time and binary size (#9712)

2024-10-02 15:49:55 +02:00

unicode-data.h

llama : reduce compile time and binary size (#9712)

2024-10-02 15:49:55 +02:00

unicode.cpp

llama : reduce compile time and binary size (#9712)

2024-10-02 15:49:55 +02:00

unicode.h

llama : move vocab, grammar and sampling into separate files (#8508)

2024-07-23 13:10:17 +03:00