From c8753ba5fefcead369daeb727206f01eeca1aecb Mon Sep 17 00:00:00 2001 From: Alex Cheema Date: Sun, 14 Jul 2024 21:12:55 -0700 Subject: [PATCH] reshuffle readme --- README.md | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/README.md b/README.md index d6c564b7..1c1bb607 100644 --- a/README.md +++ b/README.md @@ -42,20 +42,6 @@ exo will automatically discover other devices using the best method available. Z exo provides a ChatGPT-compatible API for running models. It's a one-line change in your application to run models on your own hardware using exo. -## Inference Engines - -exo supports the following inference engines: - -- [x] [MLX](inference/mlx/sharded_inference_engine.py) -- [x] [tinygrad](inference/tinygrad/inference.py) -- 🚧 [llama.cpp](TODO) - -## Networking Modules - -- ✅ [GRPC](networking/grpc) -- 🚧 [Radio](TODO) -- 🚧 [Bluetooth](TODO) - ## Installation The current recommended way to install exo is from source. @@ -92,3 +78,17 @@ An API endpoint will be available on port 8001. Example usage: ```sh curl -X POST http://localhost:8001/api/v1/chat -H "Content-Type: application/json" -d '{"messages": [{"role": "user", "content": "What is the meaning of life?"}]}' ``` + +## Inference Engines + +exo supports the following inference engines: + +- [x] [MLX](inference/mlx/sharded_inference_engine.py) +- [x] [tinygrad](inference/tinygrad/inference.py) +- 🚧 [llama.cpp](TODO) + +## Networking Modules + +- ✅ [GRPC](networking/grpc) +- 🚧 [Radio](TODO) +- 🚧 [Bluetooth](TODO) \ No newline at end of file