Skip to content

Windows ‐ Requirements & DeepSpeed

erew123 edited this page Sep 30, 2024 · 1 revision

Before installing AllTalk, ensure you have the following prerequisites:

  1. Git for cloning GitHub repositories. Installation instructions

  2. Microsoft C++ Build Tools and Windows SDK for proper Python functionality. Installation instructions

  3. Espeak-ng for multiple TTS engines to function. Installation instructions

DeepSpeed Installation

DeepSpeed for Windows will be installed automatically on a Standalone installation when using the atsetup.bat utility. Text-generation-webui users can select a version to install from within the atsetup.bat utility.

Should you have a requirement to install DeepSpeed manually into a separate Python environment, you can follow the below instructions.

Note: It's recommended to confirm AllTalk works without DeepSpeed before installation.

The current DeepSpeed build is compatible with:

  • PyTorch 2.2.1
  • Python 3.11.x

DeepSpeed Downloads

CUDA Version OS Download Link
v12.1 Windows Download
v11.8 Windows Download

For versions supporting PyTorch 2.1.x, please check the main releases page.

Checking Your Versions

To check your CUDA version within Text-generation-webui:

  1. Run cmd_windows.bat
  2. Execute:
    • python --version (for Python version)
    • pip show torch (for CUDA version)

Important: You DO NOT need to set Text-generation-webUI's --deepspeed setting for AllTalk to use DeepSpeed. These are separate functionalities, and incorrectly setting this in Text-generation-webUI may cause complications.

DeepSpeed Setting

Clone this wiki locally