Examples

 

 

Description

Source Sound

Jeep sounds.

Target Sound

Voice imitating jeep sounds.

Synthesis Constraints

Influence is a constant '1' throughout synthesis.

Comments

Replaces the voice soundtrack with a jeep soundtrack. The goal here is to replace my accelerations sounds with real ones from the jeep soundtrack. Again, the RMS volume is used as the synthesis guiding feature.

 

Target Sound

 

Original Sound along with Extracted Features

 

 

Self-Similarity Synthesis

 

Segmented Source Sound

 

Shows the segmentation boundaries on original source sound

 

 

New Sound

 

(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged.

 

 

 

 

Natural-Grain Synthesis

 

 

Segmented Source Sound

Shows the segmentation boundaries on original source sound

New Sound

(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged.