DandinPower b35e13d4f2 feat: add q2_k fast and modify q2_k logic, add preliminary support for rms_norm_aware_importance but currently assumption is wrong and will lead to corrupted result

2025-12-24 21:16:11 +08:00

..

cmake

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

arg.cpp

feat: add q2_k fast and modify q2_k logic, add preliminary support for rms_norm_aware_importance but currently assumption is wrong and will lead to corrupted result

2025-12-24 21:16:11 +08:00

arg.h

common : move arg parser code to arg.cpp (#9388)

2024-09-09 23:36:09 +02:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

CMakeLists.txt

common : reimplement logging (#9418)

2024-09-15 20:46:12 +03:00

common.cpp

feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)

2025-12-06 21:08:10 +08:00

common.h

feat: use bitsqueeze as communication compression library to replace the previous quantization/k_quantization/sparsity. Also add a new argument call comm_compression_threshold to allow user can set a threshold for compression (good for only compress prefilling tokens)

2025-12-06 21:08:10 +08:00

console.cpp

console : utf-8 fix for windows stdin (#9690)

2024-09-30 11:23:42 +03:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

json-schema-to-grammar.cpp

json: restore default additionalProperties to false, fix some pattern escapes (#8180)

2024-06-28 09:26:45 +01:00

json-schema-to-grammar.h

JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)

2024-05-08 21:53:08 +02:00

json.hpp

json-schema-to-grammar improvements (+ added to server) (#5978)

2024-03-21 11:50:43 +00:00

log.cpp

log : add CONT level for continuing previous log entry (#9610)

2024-09-24 10:15:35 +03:00

log.h

log : add CONT level for continuing previous log entry (#9610)

2024-09-24 10:15:35 +03:00

ngram-cache.cpp

common : reimplement logging (#9418)

2024-09-15 20:46:12 +03:00

ngram-cache.h

lookup: fibonacci hashing, fix crashes (#8548)

2024-07-17 23:35:44 +02:00

profiler.cpp

topo rebuild: add a delay to avoid packet interleaving

2025-06-26 14:47:34 +04:00

profiler.h

fix compute buffer estimate: tested on cuda

2025-06-22 08:10:57 +00:00

sampling.cpp

Add speculative decoding support to the server and command-line interfaces

2025-06-30 09:35:35 +00:00

sampling.h

Add speculative decoding support to the server and command-line interfaces

2025-06-30 09:35:35 +00:00

speculative.cpp

Add speculative decoding support to the server and command-line interfaces

2025-06-30 09:35:35 +00:00

speculative.h

Add speculative decoding support to the server and command-line interfaces

2025-06-30 09:35:35 +00:00

stb_image.h

common : Update stb_image.h to latest version (#9161)

2024-08-27 08:58:50 +03:00

train.cpp

common : reimplement logging (#9418)

2024-09-15 20:46:12 +03:00

train.h

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00