Building a Real-Time Digital Human Framework for Live Events
summary
Digital Domain builds a real‑time system inside Unreal Engine that runs live digital humans with autonomous cameras, lighting and character switching; the team ships a Director Framework and an N‑Character System that drives 2.5M‑vertex characters with ray tracing and VR views. Facial capture and Xsens body data go through IKINEMA, neural nets and a custom node that replicates skeletal transforms to clients; runtime demos on TED and SIGGRAPH work, but scaling needs one suit/PC per actor and host‑migration.
AI-written summary · about
chapters (11)
- 0:00New Technology Requires Frameworks
- 1:01About Digital Human Group
- 2:49A New Framework
- 5:06Director Framework Result
- 6:07Issues with Current Framework
- 7:05New N-Character System
- 8:33View into VR
- 9:06Replicating Live-Drive Skeleton
- 10:04Hardware Layout
- 10:50More Dougs, More Machines
- 11:41What's next?
related talks
51mExploring the Technology that Drives "The Human Race"
39mAnimated Digital Doubles in Unity
49mFundamentals of Linear Content Creation in Unreal Engine
01h 02mart tools: A new era of creativity
44mVirtual Cinematography and Non-Linear Editing Workflows on The Quarry
31mUnreal Engine in 2021: MetaHumans, Quixel, and Beyond
26mThe Future of Animation in Unreal Engine
32mNext generation human character control