Paper Archive

This paper presents research into scanned synthesis on a multitouch screen device. This synthesis technique involves scanning a wavetable that is dynamically evolving in the manner of a massspring network. It is argued that scanned synthesis can provide a good solution to some of the issues in digital musical instrument design, and is particularly well suited to multi-touch screens. In this implementation, vibrating mass-spring networks with a variety of configurations can be created. These can be manipulated by touching, dragging and altering the orientation of the tablet. Arbitrary scanning paths can be drawn onto the structure. Several extensions to the original scanned synthesis technique are proposed, most important of which for multi-touch implementations is the freedom of the masses to move in two dimensions. An analysis of the scanned output in the case of a 1D ideal string model is given, and scanned synthesis is also discussed as being a generalisation of a number of other synthesis methods.

Download

This paper proposes novel audio effects based on manipulating an audio signal in a representation domain provided by non-negative matrix factorization (NMF). Critical-band magnitude spectrograms Y of sounds are first factorized into a product of two lower-rank matrices so that Y ≈ BG. The parameter matrices B and G are then processed in order to achieve the desired effect. Three classes of effects were investigated: 1) dynamic range compression (or expansion) of the component spectra or gains, 2) effects based on rank-ordering the components (colums of B and the corresponding rows of G) according to acoustic features extracted from them, and then weighting each component according to its rank, and 3) distortion effects based on controlling the amount of components (and thus the reconstruction error) in the above linear approximation. The subjective quality of the effects was assessed in a listening test.

Download