Download Vocal synthesis and graphical representation of the phonetic gestures underlying guitar timbre description
The guitar is an instrument that gives the player great control over timbre. Different plucking techniques involve varying the finger position along the string, the inclination between the finger and the string, the inclination between the hand and the string and the degree of relaxation of the plucking finger. Guitarists perceive subtle variations of these parameters and they have developed a very rich vocabulary to describe the brightness, the colour, the shape and the texture of the sounds they produce on their instrument. Dark, bright, chocolatey, transparent, muddy, wooly, glassy, buttery, and metallic are just a few of those adjectives. The aim of this research is to conceive a computer tool producing the synthesis of the vocal imitation as well as the graphical representation of phonetic gestures underlying the description of the timbre of the classical guitar, as a function of the instrumental gesture parameters (mainly the plucking angle and distance from the bridge) and based on perceptual analogies between guitar and speech sounds. Similarly to the traditional teaching of tabla which uses onomatopeia to designate the different strokes, vocal imitation of guitar timbres could provide a common language to guitar performers, complementary to the mental imagery they commonly use to communicate about timbre, in a pedagogical context for example.
Download Morphing techniques for enhanced scat singing
In jazz, scat singing is a phonetic improvisation that imitates instrumental sounds. In this paper, we propose a system that aims to transform singing voice into real instrument sounds, extending the possibilities for scat singers. Analysis algorithms in the spectral domain extract voice parameters, which drive the resulting instrument sound. A small database contains real instrument samples that have been spectrally analyzed offline. Two different prototypes are introduced, producing sounds of a trumpet and a bass guitar respectively.
Download Polyphonic music analysis by signal processing and support vector machines
In this paper an original system for the analysis of harmony and polyphonic music is introduced. The system is based on signal processing and machine learning. A new multi-resolution, fast analysis method is conceived to extract time-frequency energy spectrum at the signal processing stage, while support vector machine is used as machine learning technology. Aiming at the analysis of rather general audio content, experiments are made on a huge set of recorded samples, using 19 music instruments combined together or alone, with different polyphony. Experimental results show that fundamental frequencies are detected with a remarkable success ratio and that the method can provide excellent results in general cases.
Download Audio Rendering System Design for an Object Oriented Audio Visual Human Perception Assessment Tool
The cognitive processes behind human bimodal (audio visual) perception are not well understood. This contribution presents an approach to reach a deeper understanding by means of subjective assessments of (interactive) audio visual applications. A tool developed for performing these assessments is introduced, and the audio rendering system design of that tool is explained: its modular character, the signal processing flow as well as the possible reproduction setups are discussed. Finally, an example for the assessment of geometrically based room simulation and preliminary test results are given.
Download Blind Source Separation Using Repetitive Structure
Blind source separation algorithms typically involve decorrelating time-aligned mixture signals. The usual assumption is that all sources are active at all times. However, if this is not the case, we show that the unique pattern of source activity/inactivity helps separation. Music is the most obvious example of sources exhibiting repetitive structure because it is carefully constructed. We present a novel source separation algorithm based on spatial time-time distributions that capture the repetitive structure in audio. Our method outperforms time-frequency source separation when source spectra are highly overlapping.
Download Analysis-assisted sound processing with audiosculp
Digital audio effects using phase vocoder techniques are currently in widespread use. However, their interfaces often hide vital parameters from the user. This fact, and the generally limited ways in which sound designing and compositional tools can represent sounds and their spectral content, complicates the effective use of the full potential of modern effect processing algorithms. This article talks about ways in which to use analysis to obtain better processing results with phase vocoder based effects, and how these techniques are implemented in IRCAM's AudioSculpt application. Also discussed are the advantages of using the SDIF format to exchange analysis data between various software components, which facilitates the integration of new analysis and processing algorithms.
Download Implementation of Arbitrary Linear Sound Synthesis Algorithms by Digital Wave Guide Structures
The Digital Wave Guide (DWG) method is one of the most popular techniques for digital sound synthesis via physical modeling. Due to the inherent solution of the wave equation by the structure of the DWG method, it provides a highly efficient algorithm for typical physical modeling problems. In this paper it will be shown, that it is possible to use this efficient structure for any existing linear sound synthesis algorithm. By a consequent description of discrete implementations with State Space Structures (SSSs), suitable linear state space transformations can be used to achieve the typical DWG structure from any given system. The proposed approach is demonstrated with two case studies, where a modal solution achieved with the Functional Transformation Method (FTM) is transformed to a DWG implementation. In the first example the solution of the lossless wave equation is transformed to a DWG structure, yielding an arbitrary size fractional delay filter. In another example a more elaborated model with dispersion and damping terms is transformed, resulting in a DWG model with parameter morphing features.
Download Separation of overlapping impulsive sounds by bandwise noise interpolation
The task of extracting harmonic content of multiple pitched sources from a mono audio mix has been investigated on several occasions [1, 2, 3, 4]. However, most pitched notes contain an inharmonic component, which is an important perceptual attribute of the sound. This content is usually not dealt with during separation. It would also be interesting in its own right to develop separation techniques for extracting percussive sounds for polyphonic mixes. This paper describes an attempt at separating overlapping impulsive content of multiple sources from a mono mix. The method uses an interpolation within individual frequency bands of the decaying noise envelope of each source across overlapping sections with other sources. Three analysis methods determining the distribution of these bands were tested: the DFT followed by processing in Bark bands, the discrete wavelet transform (DWT), and the dyadic wavelet packet transform (DWPT).
Download j-DAFx - Digital Audio Effects in Java
This paper describes an attempt to provide an online learning platform for digital audio effects. After a comprehensive study of different technologies presenting multimedia content dynamically reacting to user input, we decided to use Java Applets. Further investigations regard the implementation issues - especially the processing and visualization of audio data - and present a general framework used in our department. Recent and future digital effects implemented in this framework can be found on our web site.
Download On the Definition of Musical Notes from Pitch Tracks for Melody Detection in Polyphonic Recordings
The present study addresses the problem of defining musical notes from pitch tracks, in the context of a system for melody detection in polyphonic musical signals. This is an important issue for melody transcription, as well as melody-based music information retrieval. Previous work in the area tackled mainly the extraction of melodic pitch lines, without explicit determination of musical notes. Therefore, in this paper we propose an approach for the creation of musical notes based on a two-stage segmentation of pitch tracks. In the first step, frequency-based segmentation is carried out through the detection of frequency variations in pitch tracks. In the second stage, salience-based segmentation is performed so as to split consecutive notes with equal value, by making use of salience minima and note onsets.