electron-rare/mlx-lm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
test_data
mlx-lm/mlx_lm
T
History
Awni HannunandGitHub 7d042c6124 fix for rnj-1 (#657)
2025-12-08 07:16:57 -08:00
..
examples
Allow providing prompt caches in batched generation (#602)
2025-11-20 09:14:30 -08:00
models
fix for rnj-1 (#657)
2025-12-08 07:16:57 -08:00
quant
DWQ for very large models (#536)
2025-11-07 06:43:40 -08:00
tuner
fix lora fusion for non affine quantization (#647)
2025-12-03 10:33:01 -08:00
__init__.py
Make mlx-lm more type-checker friendly (#573)
2025-11-05 11:25:00 -08:00
__main__.py
benchmarks (#552)
2025-10-15 12:24:12 -07:00
_version.py
version bump (#651)
2025-12-03 15:30:36 -08:00
benchmark.py
Fix for kimi k2 (#593)
2025-11-18 06:16:42 -08:00
BENCHMARKS.md
benchmarks (#552)
2025-10-15 12:24:12 -07:00
cache_prompt.py
fix llama4 cache (#108)
2025-04-19 09:00:01 -07:00
chat.py
Add --trust-remote-code cli option (#319)
2025-07-31 22:57:21 -07:00
convert.py
Cleanup and simplify model I/O (#532)
2025-10-07 06:57:51 -07:00
evaluate.py
Add a prompt cache that can hold multiple prompts (#625)
2025-12-02 13:29:55 -08:00
fuse.py
fix dequant + minor refactor (#572)
2025-10-30 14:30:10 -07:00
generate.py
Fix slow batch generation in server by setting wired_limit (#652)
2025-12-05 11:28:17 -08:00
gguf.py
Fix export to gguf (#993)
2024-09-20 13:33:45 -07:00
LEARNED_QUANTS.md
Fix example command to quantize a model using GPTQ (#539)
2025-10-08 06:07:18 -07:00
LORA.md
Added gradient accumulation to training loop (#511)
2025-10-13 11:27:15 -07:00
lora.py
Added gradient accumulation to training loop (#511)
2025-10-13 11:27:15 -07:00
MANAGE.md
Add model management functionality for local caches (#736)
2024-05-03 12:20:13 -07:00
manage.py
Move from python -m mlx_lm.generate to python -m mlx_lm generate (#71)
2025-04-04 16:53:18 -07:00
perplexity.py
fix dequant + minor refactor (#572)
2025-10-30 14:30:10 -07:00
py.typed
Add py.typed to support PEP-561 (type-hinting) (#389)
2024-01-30 21:17:38 -08:00
README.md
feat: move lora into mlx-lm (#337)
2024-01-23 08:44:37 -08:00
sample_utils.py
fix sampling with small top k (#388)
2025-08-20 22:44:19 -07:00
SERVER.md
add default params to better run quen3 (#162)
2025-05-13 06:39:30 -07:00
server.py
Fix slow batch generation in server by setting wired_limit (#652)
2025-12-05 11:28:17 -08:00
tokenizer_utils.py
Fix Byte Decoder Lookup for Esoteric Single-Characters (#600)
2025-11-10 14:16:25 -08:00
upload.py
Support AWQ Quantization (#88)
2025-04-22 15:43:12 -07:00
utils.py
Fix for kimi k2 (#593)
2025-11-18 06:16:42 -08:00

README.md

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.

This package also supports fine tuning with LoRA or QLoRA. For more information see the LoRA documentation.

Reference in New Issue View Git Blame Copy Permalink