 Lizonghang
|
2fbc0c8da3
|
fix: reset -ngl to 0 when GPU is not used and reformat code
|
2025-05-14 13:27:20 +04:00 |
|
|
Li, Zonghang
|
b44187e3af
|
Merge pull request #9 from yezhizi/rm-profile
Remove unnecessary profiling when `-lw` is specified
|
2025-05-14 10:05:49 +08:00 |
|
|
Li, Zonghang
|
ca95b1efad
|
Merge pull request #11 from eltociear/patch-1
chore: update debug-test.sh
|
2025-04-22 00:32:19 +08:00 |
|
|
Ikko Eltociear Ashimine
|
fa1444ab3b
|
chore: update debug-test.sh
compliation -> compilation
|
2025-04-21 23:40:40 +09:00 |
|
|
DeEMO
|
cf4fa04980
|
Add an independent profile tool
|
2025-04-18 03:27:20 +00:00 |
|
|
DeEMO
|
168c14f4e8
|
remove unnecessary profile when --lw is specified
|
2025-04-17 13:49:09 +00:00 |
|
|
DeEMO
|
9cb87f7923
|
add fio file to gitignore
|
2025-04-17 13:44:23 +00:00 |
|
|
leeetao
|
fc1e2d3fc6
|
Added support for iq1s and iq1m quantization type
|
2025-04-17 10:27:53 +00:00 |
|
|
leeetao
|
b212d74dc3
|
update Readme.md
|
2025-04-17 09:17:11 +00:00 |
|
|
Zonghang Li
|
f9702ec4c0
|
update README.md
|
2025-04-16 15:55:43 +04:00 |
|
|
Zonghang Li
|
5a5f103833
|
fix q6k and q80
|
2025-04-16 08:55:07 +04:00 |
|
|
Li, Zonghang
|
b59d6d9cdf
|
Update README.md
|
2025-04-15 09:59:08 +08:00 |
|
|
Li, Zonghang
|
6d13836c44
|
Update README.md
|
2025-04-11 01:41:43 +08:00 |
|
|
Li, Zonghang
|
4845abf25e
|
Update README.md
|
2025-04-11 01:20:36 +08:00 |
|
|
Li, Zonghang
|
4ab9087d69
|
Update LICENSE
|
2025-04-09 21:42:55 +08:00 |
|
|
Lizonghang
|
e48b804730
|
update README.md
|
2025-04-09 13:55:30 +04:00 |
|
|
Li, Zonghang
|
55f8dc588f
|
Update README.md
|
2025-04-09 10:56:25 +08:00 |
|
|
Lizonghang
|
e421d788d3
|
update README
|
2025-04-08 23:15:43 +04:00 |
|
|
Lizonghang
|
03ff9a7654
|
update README
|
2025-04-07 23:28:01 +04:00 |
|
|
Li, Zonghang
|
a3a1f4499b
|
Update README.md
|
2025-04-07 22:14:44 +08:00 |
|
|
Li, Zonghang
|
98d73778a6
|
Update README.md
|
2025-04-07 22:13:31 +08:00 |
|
|
Li, Zonghang
|
5984b1b75f
|
Update README.md
|
2025-04-07 22:13:12 +08:00 |
|
|
Li, Zonghang
|
ebd15b4112
|
Update README.md
|
2025-04-07 22:12:11 +08:00 |
|
|
Li, Zonghang
|
35adc76337
|
Update README.md
|
2025-04-07 22:08:14 +08:00 |
|
|
Lizonghang
|
87eb1aa7ec
|
update README
|
2025-04-07 18:06:57 +04:00 |
|
|
Li, Zonghang
|
67b10034a7
|
update video to compare llama.cpp and prima.cpp
|
2025-04-07 18:01:04 +04:00 |
|
|
Lizonghang
|
7631ddcdc7
|
ignore video
|
2025-04-07 17:59:23 +04:00 |
|
|
Lizonghang
|
fffefb9259
|
update README
|
2025-04-07 17:57:57 +04:00 |
|
|
Lizonghang
|
f97a97003b
|
fix type convert
|
2025-04-07 17:57:50 +04:00 |
|
|
Lizonghang
|
3b264352e7
|
update README
|
2025-03-30 23:39:36 +04:00 |
|
|
Lizonghang
|
3a6cb1768f
|
add logo
|
2025-03-30 17:21:42 +04:00 |
|
|
Zonghang Li
|
63b45a4c26
|
add args -k and --force
|
2025-03-11 22:09:39 +04:00 |
|
|
Zonghang Li
|
bcfdace59b
|
add args -k and --force
|
2025-03-11 20:44:36 +04:00 |
|
|
leeetao
|
45ec52c2cb
|
Added support for IQ1_M and IQ2_XXS quantization type
|
2025-03-07 16:56:16 +00:00 |
|
|
leeetao
|
230c68b80c
|
fixed the alignment display
|
2025-03-07 07:55:23 +00:00 |
|
|
leeetao
|
6a416534c8
|
Fixed the alignment display of device performance
|
2025-03-07 07:46:30 +00:00 |
|
|
leeetao
|
54c4c1c26e
|
Fixed the flops test for iq1s and q2k quantization types
|
2025-03-07 02:47:00 +00:00 |
|
|
leeetao
|
2f049b8428
|
Added support for Q2K, IQ1s, IQ4NL quantization types
|
2025-03-04 15:22:55 +00:00 |
|
|
leeetao
|
e2cda4cfa0
|
Removed support for GGML_TYPE_Q4_0_4_4, GGML_TYPE_0_4_8, and GGML_TYPE_0_8_8 (GGUF no longer supports these types)
|
2025-03-01 14:31:38 +00:00 |
|
|
Lizonghang
|
9cbdf01645
|
fix support for Q5_0
|
2025-02-27 22:25:03 +04:00 |
|
|
Lizonghang
|
c8e615d69c
|
fix n_m bound error
|
2025-02-27 21:59:04 +04:00 |
|
|
Lizonghang
|
550fdcbc4f
|
add support for Q5_0
|
2025-02-27 21:47:14 +04:00 |
|
|
Lizonghang
|
96e68679ce
|
fix upper bound and set calibration in halda
|
2025-02-27 17:00:27 +04:00 |
|
|
Lizonghang
|
41f3708999
|
fix condition for gpu overload
|
2025-02-25 21:31:55 +04:00 |
|
|
leeetao
|
224d14eb4c
|
Merge branch 'tao' into dev
|
2025-02-24 16:48:43 +00:00 |
|
|
leeetao
|
42da179d66
|
Added parameter display for the distilled model of deepseek-qwen
|
2025-02-24 13:24:56 +00:00 |
|
|
Lizonghang
|
e3a0d0007a
|
add gpu check in set calibration
|
2025-02-23 21:56:59 +04:00 |
|
|
leeetao
|
7bf1b743fb
|
Merge branch 'dev' into lt_test
Merge dev branch updates into local branch lt_test.
|
2025-02-23 08:35:45 +00:00 |
|
|
leeetao
|
b4a9932d56
|
Added deepseek-r1-qwen vocabulary file
|
2025-02-23 08:33:57 +00:00 |
|
|
leeetao
|
f99e08b9fe
|
Added inference support for the Deepseek distilled model
|
2025-02-23 08:27:37 +00:00 |
|