diff --git a/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md b/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md index 225da1eb3..fd416c278 100644 --- a/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md +++ b/docs/modelserving/v1beta1/llm/huggingface/text_generation/README.md @@ -13,6 +13,7 @@ If the model is not supported by vLLM, KServe falls back to HuggingFace backend Create a secret with the Hugging Face token. === "Yaml" + ```yaml apiVersion: v1 kind: Secret @@ -23,6 +24,8 @@ Create a secret with the Hugging Face token. HF_TOKEN: ``` +Then create the inference service. + === "Yaml" ```yaml @@ -190,6 +193,7 @@ Create a secret with the Hugging Face token. stringData: HF_TOKEN: ``` +Then create the inference service. === "Yaml"