XR Animator v0.2.5 - Windows app version

Changes

• Improve FBX motion support (video demo)
• Improve animation retargeting for loaded motions
• Add the feature to automatically save the path of the last used 3D avatar model and enable it on start
• Fix glitching when face-locking camera is reset
• Update codes for raycasting from mouse
• Update Electron (v22.2.0)
• Update three.js and components
• Update jszip.js
• Use import map for dynamic modules

XR Animator v0.2.0 - Windows app version

Changes

• You can now build your own 3D scene with 3D objects (.x/.glb), image and video, with full control over position/rotation/scale/etc using keyboard controls (video demo)
• You can explore your own 3D scene with your avatar using standard WASD/Space controls, with 3D collisions (video demo)
• You can export/import 3D scene built with XR Animator in JSON format (for online browser version of XR Animator, you need to include all 3D objects and the scene JSON file inside a zip). A sample scene XR-Animator_scene_sample_wizard.zip is available for download as a demonstration (video demo)
• Background transparency for Windows app version (Electron) is now configurable, and is ON by default (the reason for this change is because the latest OBS now supports direct transparency capture on Electron window without using chroma key)
• Improve VRM physics
• Add support for video wallpaper
• Add "Camera face-locking" option, which allows the 3D camera to lock the face of your avatar (it's "Auto" by default, which applies only when a 3D scene is used)
• UI items have been updated and re-arranged to better suit XR Animator as a mocap app
• Fix some camera control issues in browser mode after the window has been resized
• Fix the bug which prevents external 3D objects from being removed
• Fix the wallpaper changer in browser mode
• Restore the emulation of MMD wrist twist (手捩) rotation in VRM model when using mocap

XR Animator v0.0.5 - Windows app version

Changes

• Improve eye rotation for VRM models
• Add "one Euro filter" to smooth some joint rotations (and potentially facial expressions in the future)
• Disable speech bubble transparency when green screen is used
• Fix the bug of "VSeeFace mode" on tray menu not showing the correct status sometimes
• Add electron-as-wallpaper module to restore the "Stay on desktop" feature (previously implemented in AutoIt)

XR Animator v0.0.4 - Windows app version

Changes

• All AutoIt-related executables, which are mostly irrevelant to XR Animator, have been removed to avoid confusion

XR Animator v0.0.3 - Windows app version

Changes

• Fix a regression bug in translating pose detection data to joint rotations when the person being tracked is turning backward

Personal note: I really miss the time maintaining just the online version when I don't have to upload a 300MB file just for some simple changes in one file lol

XR Animator v0.0.2 - Windows app version

Changes

• Fix a bug which breaks the app when VMC-protocol is used and the VRM model doesn't have all the bones required
• Fix the bone positions sent by VMC-protocol with correct scaling
• Fix the "Hide 3D avatar" option to actually work with VMC-protocol
• Add "VSeeFace mode" in tray menu for VMC-protocol (enable it to override the default VSeeFace camera)
• Fix some update issues with tray menu
• Reduce the scale of eye rotation for VRM models to make eye tracking look more natural
• Fix a bug in thumb rotation for VRM models

XR Animator v0.0.1 - Windows app version

This is the initial release of the Windows app version of XR Animator, our new featured web app based on System Animator Online, which supports full-body motion tracking using just a single webcam, right on your web browser. It uses the machine learning (ML) solution from MediaPipe and TensorFlow.js to detect the 3D poses from a live webcam video, which is then used to drive the 3D avatar (MMD/VRM model) as if you are controlling it with your body. It can be used for whatever XR purpose, and even for VTubing.

This Windows app version (powered by Electron) provides a few extra features (e.g. VMC-protocol, transparent background) available only in a native-OS environment.

Features

• Support full-body AI motion tracking using a single webcam or media file (image/video)

• Support using any MMD/VRM model as your 3D avatar

• Record mocap motion and export it to VMD motion format

• Support loading VMD/BVH/FBX(Mixamo) format 3D motions

• Export BVH/FBX motions to VMD format

• Customize the background with still image, 3D panorama, 3D object (.x format), or a plain simple green screen for VTubing and video recording with a transparent background

• Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Windows version only)

• Support frameless window with transparent background (via green screen) on video capture apps such as OBS (Windows version only)

Check out these YouTube video demos and watch XR Animator in action!