Description


Input Sound

Industrial soundtrack: machines, piston, coin-like and air-valve sounds.

Synthesis Constraints

 
Source 1  

 3 source segments consisting of coin-like sounds.

 

Target 1  

 Soft 0.9 segment, soft 0.9 segment, hard 1 inclusion segment, soft 0.5 segment. Rest of weights are -0.99. 

 

 

Source 2  

 2 source segments consisting of a air-valve sounds.

 

Target 2  

 Soft 0.9 segment, soft 0.9 segment, soft 0.7 segment, soft 0.5 segment. Rest of weights are -0.99.

 

 

Comments

Shows overlapping soft constraints and overlapping hard and soft constraints. Notice that for some overlapping constraints both the coin and valve sound can be heard in the target interval.

 

 

 

Self-Similarity Synthesis

 

Segmented Original Sound


 

Shows the segmentation boundaries on original sound

 

 

New Sound


 

(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows which grains were excluded from the synthesis from a hard -1 constraint. Shows which grains were hard included in the synthesis from a hard 1 constraint.

 

 

 

 

Natural-Grain Synthesis

 

 

Segmented Original Sound


Shows the segmentation boundaries on original sound

 

New Sound


(top) Shows the old segmented sound along each constraints source segments. (middle) Shows the synthesized sound. (bottom) Shows Constraint targets along with how the origin of the grains in these targets regions.

(top left) Shows the original probabilities for every grain at each instant of the synthesis over time. (top right) Shows how the original propabilities where rescaled according to the weights at that current in the synthesis. (bottom left) Illustrates the difference between the two initial and new probabilities. (bottom right) Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows the target weights for each constraints. The surface represents the final calculated weights for each grain. The final weights assigned to each grain depends on wether it satisfies or not the current constraint targets. A weight of zero means that it-s original probability is left unchanged. Shows which grains were excluded from the synthesis from a hard -1 constraint. Shows which grains were hard included in the synthesis from a hard 1 constraint.

 

 

 

 

Wavelet Synthesis

 

 

New Sound