Download TSM Toolbox: MATLAB Implementations of Time-Scale Modification Algorithms Time-scale modification (TSM) algorithms have the purpose of stretching or compressing the time-scale of an input audio signal without altering its pitch. Such tools are frequently used in scenarios like music production or music remixing. There exists a large variety of different algorithmic approaches to TSM, all of them having their very own advantages and drawbacks. In this paper, we present the TSM toolbox, which contains MATLAB implementations of several conceptually different TSM algorithms. In particular, our toolbox provides the code for a recently proposed TSM approach, which integrates different classical TSM algorithms in combination with harmonic-percussive source separation (HPSS). Furthermore, our toolbox contains several demo applications and additional code examples. Providing MATLAB code on a well-documented website under a GNU-GPL license and including illustrative examples, our aim is to foster research and education in the field of audio processing.
Download Harmonizing effect using short-time time-reversal A prior study of short-time time-reversal showed sideband modulation occurs for short time durations, creating overtones for single sinusoid signals. In this paper, we examine the overtones created by short-time time-reversal and the tonal relation between the overtones and the input signal. We present three methods of using short-time time-reversal for harmonizing audio signals. Then modifications to the previous short-time time-reversal needed to implement the proposed methods are described.
Download Parametric Coding of Stereo Audio Based on Principal Component Analysis Low bit rate parametric coding of multichannel audio is mainly based on Binaural Cue Coding (BCC). Another multichannel audio processing method called upmix can also be used to deliver multichannel audio, typically 5.1 signals, at low data rates. More precisely, we focus on existing upmix method based on Principal Component Analysis (PCA). This PCA-based upmix method aims at blindly create a realistic multichannel output signal while BCC scheme aims at perceptually restitute the original multichannel audio signal. PCA-based upmix method and BCC scheme both use spatial parameters extracted from stereo channels to generate auditory events with correct spatial attributes i.e. sound sources positions and spatial impression. In this paper, we expose a multichannel audio model based on PCA which allows a parametric representation of multichannel audio. Considering stereo audio, signals resulting from PCA can be represented as a principal component, corresponding to directional sources, and one remaining signal, corresponding to ambience signals, which are both related to original input with PCA transformation parameters. We apply the analysis results to propose a new parametric coding method of stereo audio based on subband PCA processing. The quantization of spatial and energetic parameters is presented and then associated with a state-of-the-art monophonic coder in order to derive subjective listening test results.
Download Hyper-Dimensional Digital Waveguide Mesh for Reverberation Modeling Characteristics of digital waveguide meshes with more than three physical dimensions are studied. Especially, the properties of a 4-D mesh are analyzed and compared to waveguide structures of lower dimensionalities. The hypermesh produces a response with a dense and irregular modal pattern at high frequencies, which is beneficial in modeling the reverberation of rooms or musical instrument bodies. In addition, it offers a high degree of decorrelation between output points selected at different locations, which is advantageous for multi-channel reverberation. The frequencydependent decay of the hypermesh response can be controlled using boundary filters introduced recently by one of the authors. Several hypermeshes can be effectively combined in a multirate system, in which each mesh produces reverberation on a finite frequency band. The paper presents two hypermesh application examples: the modeling of the impulse response of a lecture hall and the simulation of the response of a clavichord soundbox.
Download Energy-stable modelling of contacting modal objects with piece-wise linear interaction force In discrete-time digital models of contact of vibrating objects stability and therefore control over system energy is an important issue. While numerical approximation is problematic in this context digital algorithms may meat this challenge when based on exact mathematical solution of the underlying equation. The latter may generally be possible under certain conditions of linearity. While a system of contacting solid objects is non-linear by definition, piece-wise linear models may be used. Here however the aspect of “switching” between different linear phases is crucial. An approach is presented for exact preservation of system energy when passing between different phases of contact. One basic principle used may be pictured as inserting appropriate ideal, massless and perfectly stiff, “connection rods” at discrete moments of phase switching. Theoretic foundations are introduced and the general technique is explained and tested at two simple examples.
Download Re-targeting Expressive Musical Style Using a Machine-Learning Method Expressive musical performing style involves more than what is simply represented on the score. Performers imprint their personal style on each performances based on their musical understanding. Expressive musical performing style makes the music come alive by shaping the music through continuous variation. It is observed that the musical style can be represented by appropriate numerical parameters, where most parameters are related to the dynamics. It is also observed that performers tends to perform music sections and motives of similar shape in similar ways, where music sections and motives can be identified by an automatic phrasing algorithm. An experiment is proposed for producing expressive music from raw quantized music files using machine-learning methods like Support Vector Machines. Experimental results show that it is possible to induce some of a performer’s style by using the music parameters extracted from the audio recordings of their real performance.
Download Finding Latent Sources in Recorded Music with a Shift-invariant HDP We present the Shift-Invariant Hierarchical Dirichlet Process (SIHDP), a nonparametric Bayesian model for modeling multiple songs in terms of a shared vocabulary of latent sound sources. The SIHDP is an extension of the Hierarchical Dirichlet Process (HDP) that explicitly models the times at which each latent component appears in each song. This extension allows us to model how sound sources evolve over time, which is critical to the human ability to recognize and interpret sounds. To make inference on large datasets possible, we develop an exact distributed Gibbs sampling algorithm to do posterior inference. We evaluate the SIHDP’s ability to model audio using a dataset of real popular music, and measure its ability to accurately find patterns in music using a set of synthesized drum loops. Ultimately, our model produces a rich representation of a set of songs consisting of a set of short sound sources and when they appear in each song.
Download Fast Signal Reconstruction from Magnitude STFT Spectrogram Based on Spectrogram Consistency The modification of magnitude spectrograms is at the core of many audio signal processing methods, from source separation to sound modification or noise canceling, and reconstructing a natural sounding signal in such situations is thus a very important issue. This article presents recent theoretical and experimental developments on the application to signal reconstruction from a modified magnitude spectrogram of the constraints that an array of complex numbers must verify to be a consistent short-time Fourier transform (STFT) spectrogram, i.e., to be the STFT spectrogram of an actual real-valued signal. We give here further theoretical insights, present several potential variations on our previously introduced algorithm, investigate various techniques to speed up the signal reconstruction process, and present a thorough experimental comparison of the performance of all the considered algorithms.
Download Audio ADC dynamic range matching by means of a DSP equalizer and dynamics processor combination An ideal analog-to-digital interface should be an universal interface. Different analog devices, spanning from microphones up to HiFi control amplifiers, that vary in lower or higher nominal levels or in different output resistances, should be connected to the universal analog-to-digital interface in a plug-and-play manner. The user then should not be forced to make any necessary adjustments such as setting gain ranges or adjusting input resistances. The analog-to-digital interface consists of analog signal conditioning followed by an analog-to-digital converter. Currently, the available audio analog-to-digital converters are insufficient for these requirements due to a too small dynamic range. An alternative and already known conversion technique, not perfect for all intents and purposes, but highly feasible, is the multi range analog-to-digital converter that combines analog and very precise digital signal processing. The discussion of a particular class of multi range converters is the topic of this paper.
Download Sound morphologies due to non-linear interactions : towards a perceptive control of environmental sound-synthesis processes This paper is concerned with perceptual control strategies for physical modeling synthesis of vibrating resonant objects colliding nonlinearly with rigid obstacles. For this purpose, we investigate sound morphologies from samples synthesized using physical modeling for non-linear interactions. As a starting point, we study the effect of linear and non-linear springs and collisions on a single-degreeof-freedom system and on a stiff strings. We then synthesize realistic sounds of a stiff string colliding with a rigid obstacle. Numerical simulations allowed the definition of specific signal patterns characterizing the non linear behavior of the interaction according to the attributes of the obstacle. Finally, a global description of the sound morphology associated with this type of interaction is proposed. This study constitutes a first step towards further perceptual investigations geared towards the development of intuitive synthesis controls.