Download Chebyshev Model and Synchronized Swept Sine Method in Nonlinear Audio Effect Modeling
A new method for the identification of nonlinear systems, based on an input exponential swept sine signal has been proposed by Farina ten years ago. This method has been recently modified in purpose of nonlinear model estimation using a synchronized swept sine signal. It allows a robust and fast one-path analysis and identification of the unknown nonlinear system under test. In this paper this modified method is applied with Chebyshev polynomial decomposition. The combination of the Synchronized Swept Sine Method and Chebyshev polynomials leads to a nonlinear model consisting of several parallel branches, each branch containing a nonlinear Chebyshev polynomial following by a linear filter. The method is tested on an overdrive effect pedal to simulate an analog nonlinear effect in digital domain.
Download Harmonize-Decompose Audio Signals with Global Amplitude and Frequency Modulations
A key building block in music transcription and indexing operations is the decomposition of music signals into notes. We model a note signal as a periodic signal with slow (frequency-selective) amplitude modulation and global frequency-warping. Global frequency-warping allows for an inharmonic frequency modulation, while the global amplitude modulation allows the various harmonics of the periodic signal to decay at different speeds. The global frequency-warping is achieved by a Laguerre transform (that has shown to fit stiffed strings inharmonic behavior). Assuming additive noise, the estimation of the model parameters and the optimization is performed in a Harmonize-Extract fashion. Simulations illustrate that the extraction technique oversteps the limitation of the global AM-FM representation and analysis techniques and allows the processing of inharmonic string instruments (e.g. piano).
Download MOSPALOSEP: A Platform for the Binaural Localization and Separation of Spatial Sounds using Models of Interaural Cues and Mixture Models
In this paper, we present the MOSPALOSEP platform for the localization and separation of binaural signals. Our methods use short-time spectra of the recorded binaural signals. Based on a parametric model of the binaural mix, we exploit the joint evaluation of interaural cues to derive the location of each time-frequency bin. Then we describe different approaches to establish localization: some based on an energy-weighted histogram in azimuth space, and others based on an unsupervised number of sources identification of Gaussian mixture model combined with the Minimum Description Length. In this way, we use the revealed Gaussian Mixture Model structure to identify the particular region dominated by each source in a multi-source mix. A bank of spatial masks allows the extraction of each source according to the posterior probability or to the Maximum Likelihood binary masks. An important condition is the Windowed-Disjoint Orthogonality of the sources in the time-frequency domain. We assess the source separation algorithms specifically on instruments mix, where this fundamental condition is not satisfied.
Download Harmonic/Percussive Separation using Median Filtering
In this paper, we present a fast, simple and effective method to separate the harmonic and percussive parts of a monaural audio signal. The technique involves the use of median filtering on a spectrogram of the audio signal, with median filtering performed across successive frames to suppress percussive events and enhance harmonic components, while median filtering is also performed across frequency bins to enhance percussive events and supress harmonic components. The two resulting median filtered spectrograms are then used to generate masks which are then applied to the original spectrogram to separate the harmonic and percussive parts of the signal. We illustrate the use of the algorithm in the context of remixing audio material from commercial recordings.
Download Automatic Segmentation of the Temporal Evolution of Isolated Acoustic Musical Instruments Sounds Using Spectro-Temporal Cues
The automatic segmentation of isolated musical instrument sounds according to the temporal evolution is not a trivial task. It requires a model capable of capturing regions such as the attack, decay, sustain and release accurately for many types of instruments with different modes of excitation. The traditional ADSR amplitude envelope model does not apply universally to acoustic musical instrument sounds with different excitation methods because it uses strictly amplitude information and supposes all sounds manifest the same temporal evolution. We present an automatic segmentation technique based on a more realistic model of the temporal evolution of many types of acoustic musical instruments that incorporates both temporal and spectrotemporal cues. The method allows a robust and more perceptually relevant automatic segmentation of the isolated sounds of many musical instruments that fit the model.
Download Polyphonic Instrument Recognition for Exploring Semantic Similarities in Music
Similarity is a key concept for estimating associations among a set of objects. Music similarity is usually exploited to retrieve relevant items from a dataset containing audio tracks. In this work, we approach the problem of semantic similarity between short pieces of music by analysing their instrumentations. Our aim is to label audio excerpts with the most salient instruments (e.g. piano, human voice, drums) and use this information to estimate a semantic relation (i.e. similarity) between them. We present 3 different methods for integrating along an audio excerpt frame-based classifier decisions to derive its instrumental content. Similarity between audio files is then determined solely by their attached labels. We evaluate our algorithm in terms of label assignment and similarity assessment, observing significant differences when comparing it to commonly used audio similarity metrics. In doing so we test on music from various genres of Western music to simulate real world scenarios.
Download Mechanical Sound Synthesis: And the New Application of Force-Feedback Teleoperation of Acoustic Musical Instruments
In Mechanical Sound Synthesis, real mechanical devices are employed to create sound. Users can interact directly with the variables of the sound synthesis, making interactions more intuitive to both users and audience. We focus on real-time feedback control for Mechanical Sound Synthesis and provide a classification scheme using the reality-virtuality continuum. We discover an apparently novel paradigm, which is described as augmented virtuality for real-time feedback control. Exploring this paradigm, we present preliminary results from a system enabling a user to teleoperate acoustic percussion instruments with the aid of force feedback. Mechanical looping of the teleoperation trajectories and their transformations enables the synthesis of lifelike sounds with superhuman characteristics that are nevertheless produced by mechanical devices.
Download Digital Emulation of Distortion Effects by Wave and Phase Shaping Methods
This paper will consider wave (amplitude) and phase signal shaping techniques for the digital emulation of distortion effect processing. We examine how to determine the Wave- and Phaseshaping functions with harmonic amplitude and phase data. Three distortion effects units are used to provide test data. The action of the Wave- and Phase- shaping functions derived for these effects is demonstrated with the assistance of a superresolution frequency-domain analysis technique.
Download An Enhanced Modulation Vocoder for Selective Transposition of Pitch
In previous papers, the concept of the modulation vocoder (MODVOC) has been introduced and its general capability to perform a selective transposition on polyphonic music content has been pointed out. This renders applications possible which aim at changing the key mode of pre-recorded PCM music samples. In this paper, two enhancement techniques for selective pitch transposition by the MODVOC are proposed. The performance of the selective transposition application and the merit of these techniques are benchmarked by results obtained from a specially designed listening test methodology which is capable to govern extreme changes in terms of pitch with respect to the original audio stimuli. Results of this subjective perceptual quality assessment are presented for items that have been converted between minor and major key mode by the MODVOC and, additionally, by the first commercially available software which is also capable of handling this task.
Download String Instrument Body Modeling Using FIR Filter Design and Autoregressive Parameter Estimation
In this paper, a method is presented for modeling string instrument bodies. The crucial point of the method is a two-step filtering technique which combines advantages of both finite impulse response (FIR) filter design and autoregressive (AR) modeling. The frequency sampling method for FIR filter design enables modeling of specific resonance constellations within the magnitude spectrum, whereas a subsequent all-pole modeling step reduces the filter order. In addition, frequency warping is applied in order to further decrease the model complexity. The proposed method allows for highly-detailed modifications of individual resonances without affecting other resonances. An example for modifying a virtual violin body is presented as well as the implementation on a real-time platform which allows for experiments on perceived violin sound and musician-instrument interaction.