Angelos KatharopoulosandGitHub 2105aaf9c3 Better caching in the server (#911)

2026-03-06 13:42:56 -08:00

..

model_parallel_tests.py

DSV3 MLA (#839)

2026-02-04 12:06:42 -08:00

test_chat.py

Add system prompt to chat script (#334)

2025-07-30 08:33:33 -07:00

test_datsets.py

Use test data zipfile in CI (#662)

2025-12-08 16:13:34 -08:00

test_evaluate.py

Batch generation (#443)

2025-09-15 16:02:45 -07:00

test_finetune.py

DWQ for very large models (#536)

2025-11-07 06:43:40 -08:00

test_generate.py

Make MambaCache compatible with batch generation for nemotron-h (#690)

2026-01-08 13:42:36 -08:00

test_gguf.py

version

2025-03-13 15:37:13 -07:00

test_losses.py

fix flaky test (#643)

2025-12-02 13:33:11 -08:00

test_models.py

step3p5: use rotating cache for sliding attention layers (#949)

2026-03-04 17:17:29 -08:00

test_prompt_cache.py

Fix save/load of CacheList (#886)

2026-02-12 18:41:48 -08:00

test_sample_utils.py

Adding support for XTC (eXclude Top Choice) (#110)

2025-04-24 14:25:30 -07:00

test_server.py

Better caching in the server (#911)

2026-03-06 13:42:56 -08:00

test_tokenizers.py

DWQ for very large models (#536)

2025-11-07 06:43:40 -08:00

test_tool_parsing.py

Devstral tool parser (#874)

2026-02-11 09:41:23 -08:00

test_tuner_trainer.py

DWQ for very large models (#536)

2025-11-07 06:43:40 -08:00

test_tuner_utils.py

version

2025-03-13 15:37:13 -07:00

test_utils.py

Cleanup and simplify model I/O (#532)

2025-10-07 06:57:51 -07:00