UE5 chat bot: streaming to ElevenLabs streamed output of OpenAI/local LLM

YFA - Initial Setup

YFA - Demo

Local processing prompt-to-animation

UE5 FBX Skeletal Importer - support of morph targets

2024 08 17 09 03 36

Lip-sync still requires some work; emotional expressions are ready

UE5: Voice to facial animation: new version (test video #3)

UE5: Adding root motion to animation sequence

UE5: Voice to facial animation: new version (more)

UE5: Voice to facial animation: new version

Ynnk Voice Lip-sync: overall quality update (5.3+)

ViveMocapKit with Vive Ultimate Trackers

UE5: locally executed chat bot with voice

Ynnk Voice Lip-sync setup for model with ARKit blendspaces

UE5: combine ElevenLabs plugins with YnnkVoiceLipsync

Eleven Voice (ElevenLabs) UE5 plugin: setting up streaming via websocket

UE5 Ynnk Voice Lip-sync: testing microphone voice recognition on Android (vosk)

Ynnk Voice Lip-sync: new voice model import and packaging pipeline

Locally generated AI conversation in UE5 - now with animated MetaHumans

100% locally generated AI dialogue on UE5

2023 12 27 11 48 11 1

Collision correction for fingers animation (UE5)

Audio TTS streaming from ElevenLabs in UE5 - early version

Ynnk Voice Lip-sync: building lip-sync for streamed audio

Ultimate Tutorial for Ultimate Dialogue plugin - Overview (re-upload)

ViveMocapKit (UE5.3-OpenXR) - Capture without VR headset

ViveMocapKit (UE5.3-OpenXR) - Capture in VR headset

Fingers Mocap: Capture and edit fingers animation

Fingers Mocap: Using key frame mode

Fingers Mocap: Setup new target skeletal mesh

Fingers Mocap: Select target animation and capture fingers

Fingers Mocap in UE5 from Web Camera - #3 - Capture and Edit

Fingers Mocap in UE5 from Web-Camera - #2

Add fingers mocap to animation in UE5 from webcam

Procedural city generation

Mediapipe UE5 body mocap

ViveMocapKit: New universal tracking system (read description)

Verdict: bad in measuring size/distance, but pose detection is good enough

2023 06 12 16 13 08

ElevenLabs (text-to-speech) UE5 Integration

Ultimate Dialogue Tutorial (with MetaHuman) - Part 3/3

Ultimate Dialogue Tutorial (with MetaHuman) - Part 2/3

Ultimate Dialogue Tutorial (with MetaHuman) - Part 1/3

Vive Mocap Kit - кратко про чистку анимации прямо в UE5

Ultimate Tutorial for Ultimate Dialogue plugin - Announcement

Vive Mocap Kit: new way of calibration without VR headset

Vive Mocap Kit - Planned Update

2023 04 14 22 45 49 1

Ynnk Voice Lip-Sync: using default visemes of MetaHuman (added in UE 5.1)

UE5 MetaHuman: view head animation captured via LiveLink

UE5: generation of Root Motion and Distance curve for distance matching

Lunar Outpost

Fix root bone scaled to x100 or x10 in UE5

YnnkVoiceLipSync & MetaFace Enhancer: blend to captured facial animation (UE5)

Ynnk Voice Lip-Sync (UE5 plugin) & MetaFace Enhancer - Setup at CC4 Character (Tutorial)

Ynnk Voice Lip-Sync (UE5 plugin) & MetaFace Enhancer - Setup at MetaHuman (Tutorial)

Comparing Ynnk Voice Lip-Sync and Ynnk MetaFace Enhancer

Interaction with MetaHuman in HoloLens 2 - english

MetaHuman in HoloLens 2