We here introduce the opportunity of using visualization of sound as a control interface, for artistic live performance as well as for new digital audio effects developments. Two different approaches are exposed. The first access consists in using video matrixes for mapping the variables parameters of sound processing, with the coordinates of any controller in a 2D plane or 3D space. The second access proposes a visualization of sound that modifies sound data by processing the data of the image itself with its own graphical properties. Exploring this kind of « transducting » relation between visual and audio may be interesting for artistic creation domain using virtual surroundings; it may cause an interest for the real time digital audio, for audiovisual mixing and new interfaces for sound design. Besides, it points the opportunity of developing 3D control interfaces for audio and visual processes.

Download