Download Between Physics and Perception: Signal Models for High Level Audio Processing The use of signal models is one of the key factors enabling us to establish high quality signal transformation algorithms with intuitive high level control parameters. In the present article we will discuss signal models, and the signal transformation algorithms that are based on these models, in relation to the physical properties of the sound source and the properties of human sound perception. We will argue that the implementation of perceptually intuitive high quality signal transformation algorithms requires strong links between the signal models and the perceptually relevant physical properties of the sound source. We will present an overview over the history of 2 sound models that are used for sound transformation and will show how the past and future evolution of sound transformation algorithms is driven by our understanding of the physical world.
Download The Restoration of Single Channel Audio Recordings Based on Non-Negative Matrix Factorization and Perceptual Suppression Rule In this paper, we focus on the signal-to-noise ratio (SNR) improvement in single channel audio recordings. Many approaches have been reported in the literature. The most popular method, with many variants, is Short Time Spectral Attenuation (STSA). Although this method reduces the noise and improves the SNR, it mostly tends to introduce signal distortion and a perceptually annoying residual noise usually called musical noise. In this paper we investigate the use of Non-negative Matrix Factorization (NMF) as an alternative to the STSA for the digital curation of musical heritage. NMF is an emerging new technique in the blind extraction of signals recorded in a variety of different fields. The application of NMF to the analysis of monaural recordings is relatively recent. We show that NMF is a suitable technique to extract the clean audio signal from undesired non stationary noise in a monaural recording of ethnic music. More specifically, we introduce a perceptual suppression rule to determine how the perceptual domain is competitive compared to the acoustic domain. Moreover, we carry out a listening test in order to compare NMF with the state of the art audio restoration framework using the EBU MUSHRA test method. The encouraging results obtained with this methodology in the presented case study support their wider applicability in audio separation.
Download Virtual Acoustic Recording: An Interactive Approach In this paper, we present a framework for recording real musical auditory scenes for interactive virtual acoustic reproduction over headphones. The framework considers the parameterization of real-world soundfields and subsequent real-time auralization using a hybrid image source method/measurement-based auralization approach. First Order (FOA) and Higher Order (HOA) Ambisonics are utilized together in a single system to provide an optimized and psychoacoustically justified framework.
Download Energy Based Synthesis of Tension Modulation in Membranes Above a certain amplitude, membrane vibration becomes nonlinear due to the variation of surface tension. This leads to audible pitch glides, which greatly contribute to the characteristic timbre of tom-tom drums of the classical drum set and many other percussion instruments. Therefore, there is a strong motivation to take the tension modulation effect into account in drum synthesis. Some models do already exist that model this phenomenon, however, their computational complexity is significantly higher compared to linear membrane models. This paper applies an efficient methodology previously developed for the string to model the quasistatic part (short-time average) of the surface tension. The efficient modeling is based on the linear relationship between the quasistatic tension and membrane energy, since the energy can be computed at a relatively low computational cost. When this energy-based tension modulation is added to linear membrane models, the perceptually most relevant pitch glides are accurately synthesized, while the increase in computational complexity is negligible.
Download Practical Modeling of Bucket-Brigade Device Circuits This paper discusses the sonic characteristics of the bucket-brigade device (BBD) and associated circuitry. BBDs are integrated circuits which produce a time-delayed version of an input signal. In order to reduce aliasing, distortion, and noise, BBDs are typically accompanied by low-pass filters and compander circuitry. Through circuit analysis and measurements, each component of the BBD system can be accurately modeled.
Download Fast Signal Reconstruction from Magnitude STFT Spectrogram Based on Spectrogram Consistency The modification of magnitude spectrograms is at the core of many audio signal processing methods, from source separation to sound modification or noise canceling, and reconstructing a natural sounding signal in such situations is thus a very important issue. This article presents recent theoretical and experimental developments on the application to signal reconstruction from a modified magnitude spectrogram of the constraints that an array of complex numbers must verify to be a consistent short-time Fourier transform (STFT) spectrogram, i.e., to be the STFT spectrogram of an actual real-valued signal. We give here further theoretical insights, present several potential variations on our previously introduced algorithm, investigate various techniques to speed up the signal reconstruction process, and present a thorough experimental comparison of the performance of all the considered algorithms.