Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
c21 committed Feb 27, 2024
1 parent 45fa16d commit 9521259
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions templates/batch-llm/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Batch LLM Inference using Anyscale Jobs and vLLM

This template shows you how to:
* Run a batch LLM inference workload using vLLM and Ray Data
* Run a batch LLM inference workload using [vLLM](https://docs.vllm.ai/en/latest) and [Ray Data](https://docs.ray.io/en/latest/data/data.html)
* Deploy the batch LLM workload as an Anyscale Service

**Note**: This template can be run from this Workspace.
Expand All @@ -16,7 +16,7 @@ This Workspace Template includes an example `batch_llm_job.yaml` which can be us
* Automated failure handling
* Automated email alerting
* Record and persist outputs such as logs
*

### Step 1: Review the python code

* Open the `batch_llm.py` file
Expand Down

0 comments on commit 9521259

Please sign in to comment.