Exploring the Technology that Drives "The Human Race"
summary
Epic Games, The Mill and Arraiy build a complete real‑time pipeline to make The Human Race, claiming a world first: a live‑action short whose cars and VFX render and composite per frame on set. They create the mil Blackbird (a configurable virtual car), a mil Cyclops toolkit for camera‑locked AR compositing, and a fiducial pipeline using AprilTag plus Arraiy’s calibration for sub‑millimeter pose. Five months of work ties SDI/NDI feeds, 3072×1536 360 capture, frame‑synced EXRs and Unreal Engine look‑dev so the virtual cars reflect and match live plates in real time.
AI-written summary · about
chapters (13)
- 0:00Introduction to The Mill
- 1:29The Human Race film
- 3:09Real-time production overview
- 4:29The Blackbird virtual car
- 6:11Cyclops tracking technology
- 8:31Computer vision with Aray
- 13:51Cyclops system components
- 19:32Live demo of Blackbird
- 21:06Lighting and calibration
- 27:35Rendering and optimization
- 32:28Look development details
- 35:54Compositing in Unreal Engine
- 44:59Niagara particle effects
related talks
13mBuilding a Real-Time Digital Human Framework for Live Events
38mAutomotive Look Development with UE
27mA Rewarding Journey
34mClosing a CGI Automotive Chapter
40mAutomotive Look Development with UE
44mNever Shoot a Car on Location Again!
02mUser Group Highlights
43mInside Real-time Production: The Tools that make it Tick