Description

Source Motion with Sound

A standing-up motion with recording of my voice describing motion.

Target Motion

A series of standing-up motions spliced together (no blending).

Synthesis Constraints

Automatically defined by motion matching algorithm.

Comments

To see if the audio constraint assignment algorithm could deal with similar standing motions, we pasted together a series of standing-up motions. So given a single standing-up motion soundtrack, we want to synthesize the soundtrack for a series of different standing-up motions. The synthesized soundtrack generally behaves the same for similar target motions as in the source example.

See for this example algorithm details.

 

 

 

Self-Similarity Synthesis

 

Source Motion with Sound

 

 

 

Shows motion of the 3D barycentre of the character for the Source motion.

Shows the norm of the 3D barycentre of the character for the Source motion. The minima are selected as fragment boundaries. The minima correspond to stoppages in the motion, which are typically good markers of changes in the motion.

Shows motion of the 3D barycentre of the character for the Source motion, along with selected minima.

Target Motion

 

 

 

Shows motion of the 3D barycentre of the character for the Target motion.

Shows the norm of the 3D barycentre of the character for the Target motion. The minima are selected as fragment boundaries. The minima correspond to stoppages in the motion, which are typically good markers of changes in the motion.

Shows motion of the 3D barycentre of the character for the Target motion, along with selected minima.

 

 

New Sound

 

(top) Shows the segmented Source soundtrack along the dynamically generated constraints source segments. (middle) Shows the synthesized sound for the Target motion. (bottom) Shows Constraint targets along with the origin of the grains in these targets regions.

Shows the Euclidean distances between the each fragment of the Source motion with that of the Target motion's.