Description


Input Sound

Machine sound with intermittent clicking/popping.

Synthesis Constraints

 
Source 1  

 4 small source segments consisting of a machine popping and clicking sounds.

 

Target 1  

 For first half of new sound: hard -1 exclusion constraint. For second half of new sound: 0 weight constraint (i.e. unconstrained synthesis).

 

 

Source 2  

 6 longer source segments consisting of a machine popping and clicking sounds.

 

Target 2  

 For first half of new sound: hard -1 exclusion constraint. For second half of new sound: 0 weight constraint (i.e. unconstrained synthesis).

 

 

Comments

Uses a hard exclusion to completely remove popping and clicking sounds from the first half of the synthesized sound. Then reverts to unconstrained synthesis where pops/clicks are introduced.

 

 

 

Self-Similarity Synthesis

 

Segmented Original Sound


 

Shows the segmentation boundaries on original sound

 

 

New Sound


 

(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows which grains were excluded from the synthesis from a hard -1 constraint. Shows which grains were hard included in the synthesis from a hard 1 constraint.

 

 

 

 

Natural-Grain Synthesis

 

 

Segmented Original Sound


Shows the segmentation boundaries on original sound

 

New Sound


(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows which grains were excluded from the synthesis from a hard -1 constraint. Shows which grains were hard included in the synthesis from a hard 1 constraint.

 

 

 

 

Wavelet Synthesis

 

 

New Sound