From 6c82365ee2be6df1b5b0402238d691cc92d8c794 Mon Sep 17 00:00:00 2001 From: Piyush Acharya Date: Tue, 17 Dec 2024 18:02:34 -0800 Subject: [PATCH 1/2] Improved clarity, fixed typos, added macOS/Linux examples, and enhanced installation/debugging instructions --- README.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 9881097a4..c9688003a 100644 --- a/README.md +++ b/README.md @@ -38,7 +38,7 @@ We also welcome contributions from the community. We have a list of bounties in ### Wide Model Support -exo supports different models including LLaMA ([MLX](exo/inference/mlx/models/llama.py) and [tinygrad](exo/inference/tinygrad/models/llama.py)), Mistral, LlaVA, Qwen and Deepseek. +exo supports different models including LLaMA ([MLX](exo/inference/mlx/models/llama.py) and [tinygrad](exo/inference/tinygrad/models/llama.py)), Mistral, LlaVA, Qwen, and Deepseek. ### Dynamic Model Partitioning @@ -100,13 +100,13 @@ source install.sh - There are a number of things users have empirically found to improve performance on Apple Silicon Macs: -1. Upgrade to the latest version of MacOS 15. +1. Upgrade to the latest version of macOS Sequoia. 2. Run `./configure_mlx.sh`. This runs commands to optimize GPU memory allocation on Apple Silicon Macs. ## Documentation -### Example Usage on Multiple MacOS Devices +### Example Usage on Multiple macOS Devices #### Device 1: @@ -177,9 +177,9 @@ curl http://localhost:52415/v1/chat/completions \ }' ``` -### Example Usage on Multiple Heterogenous Devices (MacOS + Linux) +### Example Usage on Multiple Heterogenous Devices (macOS + Linux) -#### Device 1 (MacOS): +#### Device 1 (macOS): ```sh exo @@ -244,7 +244,7 @@ python3 format.py ./exo ## Known Issues -- On some versions of MacOS/Python, certificates are not installed properly which can lead to SSL errors (e.g. SSL error with huggingface.co). To fix this, run the Install Certificates command, usually: +- On some versions of macOS/Python, certificates are not installed properly which can lead to SSL errors (e.g., with huggingface.co). To fix this, run the Install Certificates command, usually: ```sh /Applications/Python 3.x/Install Certificates.command From 154e0f58e4e84862796a46fd440a694798ccc985 Mon Sep 17 00:00:00 2001 From: Piyush Acharya Date: Sat, 21 Dec 2024 19:40:53 -0800 Subject: [PATCH 2/2] Implement suggestiond --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c9688003a..5e9e9c09b 100644 --- a/README.md +++ b/README.md @@ -244,7 +244,7 @@ python3 format.py ./exo ## Known Issues -- On some versions of macOS/Python, certificates are not installed properly which can lead to SSL errors (e.g., with huggingface.co). To fix this, run the Install Certificates command, usually: +- On certain versions of Python on macOS, certificates may not installed correctly, potentially causing SSL errors (e.g., when accessing huggingface.co). To resolve this, run the `Install Certificates` command, typicall as follows: ```sh /Applications/Python 3.x/Install Certificates.command