Skip to content

Commit

Permalink
Merge pull request #561 from VerisimilitudeX/patch-1
Browse files Browse the repository at this point in the history
Improved clarity, fixed typos, added macOS/Linux examples, and enhanc…
  • Loading branch information
AlexCheema authored Dec 27, 2024
2 parents aba1bed + 154e0f5 commit 496a3b4
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ We also welcome contributions from the community. We have a list of bounties in

### Wide Model Support

exo supports different models including LLaMA ([MLX](exo/inference/mlx/models/llama.py) and [tinygrad](exo/inference/tinygrad/models/llama.py)), Mistral, LlaVA, Qwen and Deepseek.
exo supports different models including LLaMA ([MLX](exo/inference/mlx/models/llama.py) and [tinygrad](exo/inference/tinygrad/models/llama.py)), Mistral, LlaVA, Qwen, and Deepseek.

### Dynamic Model Partitioning

Expand Down Expand Up @@ -100,13 +100,13 @@ source install.sh

- There are a number of things users have empirically found to improve performance on Apple Silicon Macs:

1. Upgrade to the latest version of MacOS 15.
1. Upgrade to the latest version of macOS Sequoia.
2. Run `./configure_mlx.sh`. This runs commands to optimize GPU memory allocation on Apple Silicon Macs.


## Documentation

### Example Usage on Multiple MacOS Devices
### Example Usage on Multiple macOS Devices

#### Device 1:

Expand Down Expand Up @@ -177,9 +177,9 @@ curl http://localhost:52415/v1/chat/completions \
}'
```

### Example Usage on Multiple Heterogenous Devices (MacOS + Linux)
### Example Usage on Multiple Heterogenous Devices (macOS + Linux)

#### Device 1 (MacOS):
#### Device 1 (macOS):

```sh
exo
Expand Down Expand Up @@ -244,7 +244,7 @@ python3 format.py ./exo

## Known Issues

- On some versions of MacOS/Python, certificates are not installed properly which can lead to SSL errors (e.g. SSL error with huggingface.co). To fix this, run the Install Certificates command, usually:
- On certain versions of Python on macOS, certificates may not installed correctly, potentially causing SSL errors (e.g., when accessing huggingface.co). To resolve this, run the `Install Certificates` command, typicall as follows:

```sh
/Applications/Python 3.x/Install Certificates.command
Expand Down

0 comments on commit 496a3b4

Please sign in to comment.