Principal Component Analysis of Rasterised Audio for Cross-Synthesis
This paper describes a system for cross synthesis of rasterised time-domain audio. Rasterisation of the audio allows alignment of the macroscopic features of audio samples of instrument tones prior to principal component analysis (PCA). Specifically a novel algorithm for straightening and aligning rastogram features has been developed which is based on an interactive process incorporating the Canny detection algorithm and variable resampling. Timbral cross-synthesis is achieved by projecting a given instrument tone onto the principal components derived from a training set of sounds for a different tone. The alignment algorithm improves the efficiency of PCA for resynthesizing tones.