electron-rare/mlx-lm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
quantize_aware_training
mlx-lm/mlx_lm
T
History
Awni Hannun ec3ab6bea9 bases model can't be quantized
2025-05-07 13:28:46 -07:00
..
examples
fix / improve dsv3 (#67)
2025-04-03 13:17:04 -07:00
models
Distilled weight quantization (#129)
2025-05-03 09:06:02 -07:00
tuner
Speedup mlx_lm.evaluate and allow mlx_lm.dwq to load already quantized model (#148)
2025-05-07 13:24:08 -07:00
__init__.py
Refactor utils (#37)
2025-03-22 11:54:51 -07:00
__main__.py
Distilled weight quantization (#129)
2025-05-03 09:06:02 -07:00
_version.py
Add Qwen3 and Qwen3-MoE (#41)
2025-04-28 06:44:17 -07:00
awq.py
better calibration data (#159)
2025-05-07 07:47:11 -07:00
cache_prompt.py
fix llama4 cache (#108)
2025-04-19 09:00:01 -07:00
chat.py
Adding support for XTC (eXclude Top Choice) (#110)
2025-04-24 14:25:30 -07:00
convert.py
refactor save and include generation config (#143)
2025-05-02 10:01:17 -07:00
dwq.py
Update defaults + layer selection
2025-05-07 13:27:51 -07:00
evaluate.py
Speedup mlx_lm.evaluate and allow mlx_lm.dwq to load already quantized model (#148)
2025-05-07 13:24:08 -07:00
fuse.py
refactor save and include generation config (#143)
2025-05-02 10:01:17 -07:00
generate.py
Add top-k sampling parameter to the CLI (#120)
2025-04-25 07:29:29 -07:00
gguf.py
Fix export to gguf (#993)
2024-09-20 13:33:45 -07:00
LEARNED_QUANTS.md
Distilled weight quantization (#129)
2025-05-03 09:06:02 -07:00
LORA.md
ConcatenatedDataset error fix (#60)
2025-03-31 10:49:22 -07:00
lora.py
fix lora test (#156)
2025-05-06 12:02:34 -07:00
MANAGE.md
Add model management functionality for local caches (#736)
2024-05-03 12:20:13 -07:00
manage.py
Move from python -m mlx_lm.generate to python -m mlx_lm generate (#71)
2025-04-04 16:53:18 -07:00
MERGE.md
Create executables for generate, lora, server, merge, convert (#682)
2024-04-16 16:08:49 -07:00
merge.py
Move from python -m mlx_lm.generate to python -m mlx_lm generate (#71)
2025-04-04 16:53:18 -07:00
py.typed
Add py.typed to support PEP-561 (type-hinting) (#389)
2024-01-30 21:17:38 -08:00
qat.py
bases model can't be quantized
2025-05-07 13:28:46 -07:00
README.md
feat: move lora into mlx-lm (#337)
2024-01-23 08:44:37 -08:00
sample_utils.py
Add top-k sampling parameter to the CLI (#120)
2025-04-25 07:29:29 -07:00
SERVER.md
Server draft (#85)
2025-04-22 13:57:22 -07:00
server.py
Optimize prompt cache handling and add tests (Fixes #137) (#138)
2025-05-01 21:21:41 -07:00
tokenizer_utils.py
Patch tokenizer utils to match MLX-VLM (#107)
2025-04-19 08:28:52 -07:00
UPLOAD.md
Mlx llm package (#301)
2024-01-12 10:25:56 -08:00
upload.py
Support AWQ Quantization (#88)
2025-04-22 15:43:12 -07:00
utils.py
refactor save and include generation config (#143)
2025-05-02 10:01:17 -07:00

README.md

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.

This package also supports fine tuning with LoRA or QLoRA. For more information see the LoRA documentation.

Reference in New Issue View Git Blame Copy Permalink