diff --git a/README.md b/README.md index 2c79116c..2157c95f 100644 --- a/README.md +++ b/README.md @@ -27,6 +27,15 @@ exo connects all your devices into an AI cluster. Not only does exo enable runni - **Tensor Parallelism**: exo supports sharding models, for up to 1.8x speedup on 2 devices and 3.2x speedup on 4 devices. - **MLX Support**: exo uses [MLX](https://github.com/ml-explore/mlx) as an inference backend and [MLX distributed](https://ml-explore.github.io/mlx/build/html/usage/distributed.html) for distributed communication. +## Dashboard + +exo includes a built-in dashboard for managing your cluster and chatting with models. + +

+ exo dashboard - cluster view showing 4 x M3 Ultra Mac Studio with DeepSeek v3.1 and Kimi-K2-Thinking loaded +

+

4 × 512GB M3 Ultra Mac Studio running DeepSeek v3.1 (8-bit) and Kimi-K2-Thinking (4-bit)

+ ## Benchmarks
diff --git a/docs/imgs/dashboard-cluster-view.png b/docs/imgs/dashboard-cluster-view.png new file mode 100644 index 00000000..9754042d Binary files /dev/null and b/docs/imgs/dashboard-cluster-view.png differ