Skip to content

Releases: yum-food/TaSTT

v0.7.0

19 Feb 20:17
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.4 setup guide: https://youtu.be/GM_LNdliKyY

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Add capability back up and restore Python dependencies locally in the Debug panel. If you use this, you won't have to re-download dependencies on subsequent upgrades.
  • Un-cap exponential backoff when not transcribing. This further reduces resource usage when not transcribing.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements for custom chatbox:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • 1 free slot in avatar menu
  • No write defaults on your animations (may work with them, but this is not tested)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.6.0

12 Feb 21:35
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.4 setup guide: https://youtu.be/GM_LNdliKyY

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Add checkbox to clear OSC configs upon Unity asset generation. This fixes a common bug when updating an existing avatar. VRC SDK does not add the STT parameters to the avatar's OSC config, causing the text box to not work in game. By clearing the configs, VRC SDK regenerates them, and the regenerated config includes STT parameters.
  • Custom chatbox supports custom cubemaps.
  • Improve PII (personally identifiable information) filter in GUI.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements for custom chatbox:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • 1 free slot in avatar menu
  • No write defaults on your animations (may work with them, but this is not tested)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.5.0

04 Feb 23:43
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.4 setup guide: https://youtu.be/GM_LNdliKyY

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Implement simple anti-aliasing. Custom text box now takes 5 samples per pixel
    by default and averages them together. This improves readability.
    • The amount of anti-aliasing can be configured in the shader.
  • Improve dithering. Dithering gets stronger as you get farther away and weaker
    as you get closer.
    • Dithering can be disabled in the shader.
  • Change default font to Noto Sans Mono bold. It's more readable than the
    previous font, and what I wanted to use originally.
  • Built-in chatbox no longer shows empty messages. Sorry about this!
  • Add debug panel to GUI. This should help diagnose and fix a few common
    problems.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements for custom chatbox:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.4.1

29 Jan 00:33
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.4 setup guide: https://youtu.be/GM_LNdliKyY

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Hotfixes:

  • Fix issue causing future-0.18.2 to fail to install on some machines

Significant changes:

  • Customize the appearance of the chatbox with textures!
  • Configure which button starts/stops transcription
  • Enable mipmaps on font textures, reducing VRAM usage
  • Improve font rendering with dithering
  • Setting up python virtual env no longer hangs the GUI
  • Fetch package dependencies (e.g. Python) at build time instead of checking them in

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.4.0

28 Jan 22:22
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.4 setup guide: https://youtu.be/GM_LNdliKyY

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Customize the appearance of the chatbox with textures!
  • Configure which button starts/stops transcription
  • Enable mipmaps on font textures, reducing VRAM usage
  • Improve font rendering with dithering
  • Setting up python virtual env no longer hangs the GUI
  • Fetch package dependencies (e.g. Python) at build time instead of checking them in

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.3.1

23 Jan 00:54
Compare
Choose a tag to compare

Download the .zip at the bottom of this page, then install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.1 setup guide: https://www.youtube.com/watch?v=e6vpz-bSjFs

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Hotfix v0.3 bug: correct how bytes per char is plumbed in Unity app
  • Enable using built-in chatbox! You no longer need to put the custom chatbox on your avatar unless you want to. This means you can use the STT with public avatars. (Caveat: the built-in chatbox is limited to one update every ~2 seconds, meaning it's less real-time than the custom chatbox)
  • Unity app input fields persist across app restarts. You no longer need to re-enter the same data every time you update an avatar.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.3

22 Jan 23:48
Compare
Choose a tag to compare

First, install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.1 setup guide: https://www.youtube.com/watch?v=e6vpz-bSjFs

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Enable using built-in chatbox! You no longer need to put the custom chatbox on your avatar unless you want to. This means you can use the STT with public avatars. (Caveat: the built-in chatbox is limited to one update every ~2 seconds, meaning it's less real-time than the custom chatbox)
  • Unity app input fields persist across app restarts. You no longer need to re-enter the same data every time you update an avatar.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.2

08 Jan 19:25
Compare
Choose a tag to compare

First, install 1 dependency:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.

Then follow the v0.1 setup guide: https://www.youtube.com/watch?v=e6vpz-bSjFs

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • expose a CPU mode in the GUI, allowing users without an NVIDIA GPU to use the software.
  • transcription app settings persist across app restarts, so you don't have to re-enter them every time.
  • paths in the unity app can now contain spaces.
  • embed git in the package, eliminating the need to have it installed on the system.
  • exe is now statically linked.

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare (recommended)

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

  • Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.1

31 Dec 22:15
Compare
Choose a tag to compare

First, install 2 dependencies:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.
  • git

Then follow the setup guide: https://www.youtube.com/watch?v=e6vpz-bSjFs

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Significant changes:

  • Board size is now configurable
  • Characters per sync is now configurable
    • More characters per sync -> better performance (but uses more avatar parameters)
  • Bytes per character is now configurable
    • English speakers need 1, non-English speakers need 2
  • GUI Unity panel tells you how many avatar parameters the selected configuration will use ahead of time
  • Shader improvements
    • Backplate can be a user-provided texture
    • Text box border has a little shader on it to make it prettier
    • Text box has rounded edges
    • Border size and rounding are configurable
  • Transcription window size is now configurable
    • Longer window size -> slower, more accurate transcriptions
    • Shorter window size -> faster, more unstable transcriptions
  • Add help text to all input fields in GUI
  • Users can disable the local beep that indicates when the STT is listening

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • An NVIDIA GPU with least 2GB of VRAM to spare
    • Tested on a 1080 ti and a 3090; saw comparable transcription times when using base.en in both setups

Avatar requirements:

  • At least 65 bits of unused avatar parameters
  • 1 free material slot
  • No write defaults on your animations (a fix for this is coming soon)

How to update an existing avatar:

Simply regenerate your avatar assets using the GUI, then upload. Unity will automatically pick up the new shader, animations, and avatar descriptor components.

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters

v0.0

22 Dec 22:16
Compare
Choose a tag to compare

This is the first release of TaSTT intended for broad use.

First, install 2 dependencies:

  • Microsoft Visual C++ Redistributable. Direct link: vc_redist.x64.exe. Required by some Python dependencies.
  • git

Then follow the setup guide: https://www.youtube.com/watch?v=0qjxkdVTqcs

Please report all issues to the discord: https://discord.gg/YWmCvbCRyn

Hardware requirements:

  • ~5GB of disk space (my python dependencies are big)
  • At least 2GB of VRAM to spare
    • Tested on a 1080 ti and a 3090; saw comparable transcription times when using base.en in both setups

Avatar requirements:

  • At least 145 bits of unused avatar parameters (will make this configurable)
  • 2 free material slots (will reduce this to 1 soon)
  • No write defaults on your animations (a fix for this is coming soon)

Known issues:

  • Text can randomly show up in the bottom right of the display
  • Continuous transcription can mangle the beginning of the transcription
  • Temporal instability at the transcription layer can cause the paging layer to re-send text, causing slowness
  • Beginning to transcribe can be slow due to long sleep()s when paused
  • Launching the transcription engine before steamVR makes the steamVR thread crash, requiring you to restart the engine to make it work

How to uninstall:

  • Simply delete the TaSTT/ directory. All runtime dependencies are installed under Resources/.
  • If you put it on an avatar:
    • Delete TaSTT_Generated
    • Delete World-Constraint from your hierarchy
    • Update your avatar descriptor to use your old FX controller, menu, and parameters