~/talk

Creating for Vision Pro with AI

Talkat Let's visionOS 2024 · 2024-03-30..03-31· [creative-coding, web-animation]
name:Simon Lee
links:none on file
slides:none on file

Demonstrations show AI-generated 360° environments via Skybox (Stable Diffusion), real-time style transfer using ControlNet and Pix2Pix Turbo, and precise per-object masks from SAM/EfficientSam to turn cars, people or walls into pixel art or Van Gogh oil versions. A Blender geometry-nodes pipeline produces real-time 3D assets textured by AI, exported into Vision Pro scenes; demos run live (with some latency) and claim feasibility for on-device or low-latency cloud rendering, though physical-safety and tracking caveats remain.

AI-written summary · about

  1. 0:00Introduction and speakers
  2. 1:03AI and design in Vision Pro
  3. 4:00Immersive 3D spaces with AI
  4. 10:42Spatial style transfer demos
  5. 21:39Real-time AI style transformation
  6. 28:20AI generation speed and feasibility
  7. 33:00AI style transfer workflow
  8. 35:56Future of AI in Vision Pro
  9. 37:16Q&A and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.