Presentation / Installation


Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models
DescriptionWe present diffusion models for audio-driven synthesis of high-quality 3D motion, with dancing and co-speech gesticulation as example applications. Our architecture uses Conformers and translation-invariant self attention. Optional style control is provided through classifier-free guidance. We also demonstrate results on path-driven locomotion and a novel formulation of diffusion-model ensembles.
Event Type
Technical Paper
TimeMonday, 7 August 20232:22pm - 2:33pm PDT
ACM Digital Library Technical Papers pdfs
Session Time & Location
Sunday, 6 August 20236pm - 8:30pm PDTWest Hall B
Monday, 7 August 20232pm - 3:30pm PDTPetree Hall C
Interest Areas
Research & Education
Recordings
Livestreamed
Recorded
Keywords
Animation/Simulation
Artificial Intelligence/Machine Learning
Registration Categories
FC
FCS
V
VS
EFC