Download Between Physics and Perception: Signal Models for High Level Audio Processing
The use of signal models is one of the key factors enabling us to establish high quality signal transformation algorithms with intuitive high level control parameters. In the present article we will discuss signal models, and the signal transformation algorithms that are based on these models, in relation to the physical properties of the sound source and the properties of human sound perception. We will argue that the implementation of perceptually intuitive high quality signal transformation algorithms requires strong links between the signal models and the perceptually relevant physical properties of the sound source. We will present an overview over the history of 2 sound models that are used for sound transformation and will show how the past and future evolution of sound transformation algorithms is driven by our understanding of the physical world.
Download The Restoration of Single Channel Audio Recordings Based on Non-Negative Matrix Factorization and Perceptual Suppression Rule
In this paper, we focus on the signal-to-noise ratio (SNR) improvement in single channel audio recordings. Many approaches have been reported in the literature. The most popular method, with many variants, is Short Time Spectral Attenuation (STSA). Although this method reduces the noise and improves the SNR, it mostly tends to introduce signal distortion and a perceptually annoying residual noise usually called musical noise. In this paper we investigate the use of Non-negative Matrix Factorization (NMF) as an alternative to the STSA for the digital curation of musical heritage. NMF is an emerging new technique in the blind extraction of signals recorded in a variety of different fields. The application of NMF to the analysis of monaural recordings is relatively recent. We show that NMF is a suitable technique to extract the clean audio signal from undesired non stationary noise in a monaural recording of ethnic music. More specifically, we introduce a perceptual suppression rule to determine how the perceptual domain is competitive compared to the acoustic domain. Moreover, we carry out a listening test in order to compare NMF with the state of the art audio restoration framework using the EBU MUSHRA test method. The encouraging results obtained with this methodology in the presented case study support their wider applicability in audio separation.
Download Parametric Multi-Channel Separation and Re-Panning of Harmonic Sources
In this paper, a method for separating stereophonic mixtures into their harmonic constituents is proposed. The method is based on a harmonic signal model. An observed mixture is decomposed by first estimating the panning parameters of the sources, and then estimating the fundamental frequencies and the amplitudes of the harmonic components. The number of sources and their panning parameters are estimated using an approach based on clustering of narrowband interaural level and time differences. The panning parameter distribution is modelled as a Gaussian mixture and the generalized variance is used for selecting the number of sources. The fundamental frequencies of the sources are estimated using an iterative approach. To enforce spectral smoothness when estimating the fundamental frequencies, a codebook of magnitude amplitudes is used to limit the amount of energy assigned to each harmonic. The source models are used to form Wiener filters which are used to reconstruct the sources. The proposed method can be used for source re-panning (demonstration given), remixing, and multi-channel upmixing, e.g. for hi-fi systems with multiple loudspeakers.
Download Large-scale Real-time Modular Physical Modeling Sound Synthesis
Due to recent increases in computational power, physical modeling synthesis is now possible in real time even for relatively complex models. We present here a modular physical modeling instrument design, intended as a construction framework for string- and bar- based instruments, alongside a mechanical network allowing for arbitrary nonlinear interconnection. When multiple nonlinearities are present in a feedback setting, there are two major concerns. One is ensuring numerical stability, which can be approached using an energy-based framework. The other is coping with the computational cost associated with nonlinear solvers—standard iterative methods, such as Newton-Raphson, quickly become a computational bottleneck. Here, such iterative methods are sidestepped using an alternative energy conserving method, allowing for great reduction in computational expense or, alternatively, to real-time performance for very large-scale nonlinear physical modeling synthesis. Simulation and benchmarking results are presented.
Download Assessing The Suitability of the Magnitude Slope Deviation Detection Criterion For Use In Automatic Acoustic Feedback Control
Acoustic feedback is a recurrent problem in live sound reinforcement scenarios. Many attempts have been made to produce an automated feedback cancellation system, but none have seen widespread use due to concerns over the accuracy and transparency of feedback howl cancellation. This paper investigates the use of the Magnitude Slope Deviation (MSD) algorithm to intelligently identify feedback howl in live sound scenarios. A new variation on this algorithm is developed, tested, and shown to be much more computationally efficient without compromising detection accuracy. The effect of varying the length of the frequency spectrum history buffer available for analysis is evaluated across various live sound scenarios. The MSD algorithm is shown to be very accurate in detecting howl frequencies amongst the speech and classical music stimuli tested here, but inaccurate in the rock music scenario even when a long history buffer is used. Finally, a new algorithm for setting the depth of howl-cancelling notch filters is proposed and investigated. The algorithm shows promise in keeping frequency attenuation to a minimum required level, but the approach has some problems in terms of time taken to cancel howl.
Download Complexity Scaling of Audio Algorithms: Parametrizing the MPEG Advanced Audio Coding Rate-Distortion Loop
Implementations of audio algorithms on embedded devices are required to consume minimal memory and processing power. Such applications can usually tolerate numerical imprecisions (distortion) as long as the resulting perceived quality is not degraded. By taking advantage of this error-tolerant nature the algorithmic complexity can be reduced greatly. In the context of real-time audio coding, these algorithms can benefit from parametrization to adapt rate-distortion-complexity (R-D-C) trade-offs. We propose a modification to the rate-distortion loop in the quantization and coding stage of a fixed-point implementation of the Advanced Audio Coding (AAC) encoder to include complexity scaling. This parametrization could allow the control of algorithmic complexity through instantaneous workload measurements using the target processor’s task scheduler to better assign processing resources. Results show that this framework can be tuned to reduce a significant amount of the additional workload caused by the ratedistortion loop while remaining perceptually equivalent to the fullcomplexity version. Additionally, the modification allows a graceful degradation when transparency cannot be met due to limited computational capabilities.
Download A Computational Model of the Hammond Organ Vibrato/Chorus using Wave Digital Filters
We present a computational model of the Hammond tonewheel organ vibrato/chorus, a musical audio effect comprising an LC ladder circuit and an electromechanical scanner. We model the LC ladder using the Wave Digital Filter (WDF) formalism, and introduce a new approach to resolving multiple nonadaptable linear elements at the root of a WDF tree. Additionally we formalize how to apply the well-known warped Bilinear Transform to WDF discretization of capacitors and inductors and review WDF polarity inverters. To model the scanner we propose a simplified and physically-informed approach. We discuss the time- and frequency-domain behavior of the model, emphasizing the spectral properties of interpolation between the taps of the LC ladder.
Download Fixed-rate Modeling of Audio Lumped Systems: A Comparison Between Trapezoidal and Implicit Midpoint Methods
This paper presents a comparison framework to study the relative benefits of the typical trapezoidal method with the lesser-used implicit midpoint method for the simulation of audio lumped systems at a fixed rate. We provide preliminary tools for understanding the behavior and error associated with each method in connection with typical analysis approaches. We also show implementation strategies for those methods, including how an implicit midpoint method solution can be generated from a trapezoidal method solution and vice versa. Finally, we present some empirical analysis of the behavior of each method for a simple diode clipper circuit and provide an approach to help interpret their relative performance and how to pick the more appropriate method depending on desirable properties. The presented tools are also intended as a general approach to interpret the performance of discretization approaches at large in the context of fixed-rate simulation.
Download Virtual Analog Buchla 259 Wavefolder
An antialiased digital model of the wavefolding circuit inside the Buchla 259 Complex Waveform Generator is presented. Wavefolding is a type of nonlinear waveshaping used to generate complex harmonically-rich sounds from simple periodic waveforms. Unlike other analog wavefolder designs, Buchla’s design features five op-amp-based folding stages arranged in parallel alongside a direct signal path. The nonlinear behavior of the system is accurately modeled in the digital domain using memoryless mappings of the input–output voltage relationships inside the circuit. We pay special attention to suppressing the aliasing introduced by the nonlinear frequency-expanding behavior of the wavefolder. For this, we propose using the bandlimited ramp (BLAMP) method with eight times oversampling. Results obtained are validated against SPICE simulations and a highly oversampled digital model. The proposed virtual analog wavefolder retains the salient features of the original circuit and is applicable to digital sound synthesis.
Download Physical parameters of an oscillator changed by active control: application to a xylophone bar
By applying active control to an oscillator, its modal behaviour changes. This paper makes a comparison between a second order damped harmonic oscillator and a xylophone bar’s mode. Then it proposes a method for acting on an eigen resonance of a xylophone bar. The purpose is to get sound modifications, by bringing under quantitative and independent control its pitch and its duration. Thus it extends our previous work [1], by using a digital feedback controller.