mlx-lm

electron-rare/mlx-lm

Fork 0

Files

T

History

Arun Raj df1d3f3c9a Fix Gemma 4 sanitize() not stripping KV projections for shared layers (#1240 )

2026-05-04 15:26:18 -07:00

chat_templates

Deepseek V3.2 implementation fixes (#838 )

2026-02-03 07:58:29 -08:00

examples

Batch generation refactoring and various fixes (#1072 )

2026-04-01 15:07:50 -07:00

models

Fix Gemma 4 sanitize() not stripping KV projections for shared layers (#1240 )

2026-05-04 15:26:18 -07:00

quant

Fix dwq: check for actual safetensors in target_dir (#1173 )

2026-04-21 00:41:53 -07:00

tool_parsers

Fix Gemma4 tool parser: support hyphenated names and braces in strings (#1150 )

2026-04-21 01:15:58 -07:00

tuner

Clear cache trainer memory (#986 )

2026-03-13 18:19:53 -07:00

__init__.py

Make mlx-lm more type-checker friendly (#573 )

2025-11-05 11:25:00 -08:00

__main__.py

Bump mlx version and version (#816 )

2026-01-28 17:10:49 -08:00

_version.py

Bump the patch version (#1124 )

2026-04-08 02:04:27 -07:00

benchmark.py

Batch generation refactoring and various fixes (#1072 )

2026-04-01 15:07:50 -07:00

BENCHMARKS.md

benchmarks (#552 )

2025-10-15 12:24:12 -07:00

cache_prompt.py

custom dsv32 chat template (#693 )

2025-12-22 13:52:58 -08:00

chat.py

Sync random seed across ranks in distributed chat (#801 )

2026-01-23 07:56:20 -08:00

cli.py

Share model (#871 )

2026-02-13 15:48:37 -08:00

convert.py

fix: convert() uses incorrect defaults for quantization mode (#935 )

2026-03-05 17:02:34 -08:00

evaluate.py

bump transformers (#746 )

2026-01-21 13:45:15 -08:00

fuse.py

Fix fusion and test (#668 )

2025-12-08 16:39:46 -08:00

generate.py

Thread local generation stream (#1090 )

2026-04-22 00:34:09 -07:00

gguf.py

Fix export to gguf (#993 )

2024-09-20 13:33:45 -07:00

LEARNED_QUANTS.md

Fix example command to quantize a model using GPTQ (#539 )

2025-10-08 06:07:18 -07:00

LORA.md

Make validation set optional in training process (#857 )

2026-02-10 15:24:44 -08:00

lora.py

Clear cache trainer memory (#986 )

2026-03-13 18:19:53 -07:00

MANAGE.md

Add model management functionality for local caches (#736 )

2024-05-03 12:20:13 -07:00

manage.py

Move from python -m mlx_lm.generate to python -m mlx_lm generate (#71 )

2025-04-04 16:53:18 -07:00

perplexity.py

Add the trust remote code option to mlx_lm perplexity (#896 )

2026-02-15 20:43:23 -08:00

py.typed

Add py.typed to support PEP-561 (type-hinting) (#389 )

2024-01-30 21:17:38 -08:00

README.md

feat: move lora into mlx-lm (#337 )

2024-01-23 08:44:37 -08:00

sample_utils.py

perf: use max instead of argsort in apply_min_p sampling (#1083 )

2026-04-01 16:26:59 -07:00

SERVER.md

Presence and frequency penalties (#971 )

2026-03-09 22:26:39 -07:00

server.py

Thread local generation stream (#1090 )

2026-04-22 00:34:09 -07:00

share.py

Share model (#871 )

2026-02-13 15:48:37 -08:00

tokenizer_utils.py

fix: handle NoneType check for think tokens in TokenizerWrapper (#1167 )

2026-04-21 01:13:15 -07:00

upload.py

Support AWQ Quantization (#88 )

2025-04-22 15:43:12 -07:00

utils.py

Thread local generation stream (#1090 )

2026-04-22 00:34:09 -07:00

README.md

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.

This package also supports fine tuning with LoRA or QLoRA. For more information see the LoRA documentation.