Download Barberpole Phasing and Flanging Illusions
Various ways to implement infinitely rising or falling spectral notches, also known as the barberpole phaser and flanging illusions, are described and studied. The first method is inspired by the Shepard-Risset illusion, and is based on a series of several cascaded notch filters moving in frequency one octave apart from each other. The second method, called a synchronized dual flanger, realizes the desired effect in an innovative and economic way using two cascaded time-varying comb filters and cross-fading between them. The third method is based on the use of single-sideband modulation, also known as frequency shifting. The proposed techniques effectively reproduce the illusion of endlessly moving spectral notches, particularly at slow modulation speeds and for input signals with a rich frequency spectrum. These effects can be programmed in real time and implemented as part of a digital audio processing system.
Download The development of an online course in DSP eartraining
The authors present a collaborative effort on establishing an online course in DSP eartraining. The paper reports from a preliminary workshop that covered a large range of topics such as eartraining in music education, terminology for sound characterization, e-learning, automated tutoring, DSP techniques, music examples and audio programming. An initial design of the web application is presented as a rich content database with flexible views to allow customized online presentations. Technical risks have already been mitigated through prototyping.
Download A Complex Wavelet Based Fundamental Frequency Estimator in Single-Channel Polyphonic Signals
In this work, a new estimator of the fundamental frequencies (F0 ) present in a polyphonic single-channel signal is developed. The signal is modeled in terms of a set of discrete partials obtained by the Complex Continuous Wavelet Transform (CCWT). The fundamental frequency estimation is based on the energy distribution of the detected partials of the input signal followed by an spectral smoothness technique. The proposed algorithm is designed to work with suppressed fundamentals, inharmonic partials and harmonic related sounds. The detailed technique has been tested over a set of input signals including polyphony 2 to 6, with high precision results that show the strength of the algorithm. The obtained results are very promising in order to include the developed algorithm as the basis of Blind Sound Source Separation or automatic score transcription techniques.
Download Rumbator: a Flamenco Rumba Cover Version Generator Based on Audio Processing at Note Level
In this article, a scheme to automatically generate polyphonic flamenco rumba versions from monophonic melodies is presented. Firstly, we provide an analysis about the parameters that defines the flamenco rumba, and then, we propose a method for transforming a generic monophonic audio signal into such a style. Our method firstly transcribes the monophonic audio signal into a symbolic representation, and then a set of note-level audio transformations based on music theory is applied to the monophonic audio signal in order to transform it to the polyphonic flamenco rumba style. Some audio examples of this transformation software are also provided.
Download Audio Signal Extrapolation - Theory and Applications
A method for extrapolating discrete audio signals is described. The theory of extrapolation is studied and some applications are presented and demonstrated. The extrapolation method is fast and capable of extrapolating several thousand samples of CD-quality audio signals. The extrapolation is applied in practice to enhance the spectral resolution in short-time fast Fourier transform based methods. It is also applied to eliminate impulsive noise bursts and to recover missing signal sections.
Download Resolving Wave Digital Filters with Multiple/Multiport Nonlinearities
We present a novel framework for developing Wave Digital Filter (WDF) models from reference circuits with multiple/multiport nonlinearities. Collecting all nonlinearities into a vector at the root of a WDF tree bypasses the traditional WDF limitation to a single nonlinearity. The resulting system has a complicated scattering relationship between the nonlinearity ports and the ports of the rest of the (linear) circuit, which can be solved by a Modified-NodalAnalysis-derived method. For computability reasons, the scattering and vector nonlinearity must be solved jointly; we suggest a derivative of the K-method. This novel framework significantly expands the class of appropriate WDF reference circuits. A case study on a clipping stage from the Big Muff Pi distortion pedal involves both a transistor and a diode pair. Since it is intractable with standard WDF methods, its successful simulation demonstrates the usefulness of the novel framework.
Download Resynthesis of coupled piano strings vibrations based on physical modeling
This paper presents a technique to resynthesize the sound generated by the vibrations of two piano strings tuned to a very close pitch and coupled at the bridge level. Such a mechanical system produces doublets of components generating beats and double decays on the amplitudes of the partials of the sound. We design a waveguide model by coupling two elementary waveguide models. This model is able to reproduce perceptually relevant sounds. The parameters of the model are estimated from the analysis of real signals collected directly on the strings by laser velocimetry. Sound transformations can be achieved by modifying relevant parameters and simulate physical situations.
Download Efficient linear prediction for digital audio effects
In many audio applications an appropriate spectral estimation from a signal sequence is required. A common approach for this task is the linear prediction [1] where the signal spectrum is modelled by an all-pole (purely recursive) IIR (infinite impulse response) filter. Linear prediction is commonly used for coding of audio signals leading to linear predictive coding (LPC). But also some audio effects can be created using the spectral estimation of LPC. In this paper we consider the use of LPC in a real-time system. We investigate several methods of calculating the prediction coefficients to have an almost fixed workload each sample. We present modifications of the autocorrelation method and of the Burg algorithm for a sample-based calculation of the filter coefficients as alternative for the gradient adaptive lattice (GAL) method. We discuss the obtained prediction gain when using these methods regarding the required complexity each sample. The desired constant workload leads to a fast update of the spectral model which is of great benefit for both coding and audio effects.
Download Analysis of piano tones using an inharmonic inverse comb filter
This paper presents a filter configuration for canceling and separating partials from inharmonic piano tones. The proposed configuration is based on inverse comb filtering, in which the delay line is replaced with a high-order filter that has a proper phase response. Two filter design techniques are tested with the method: an FIR filter, which is designed using frequency sampling, and an IIR filter, which consists of a set of second-order allpass filters that match the desired group delay. It is concluded that it is possible to obtain more accurate results with the FIR filter, while the IIR filter is computationally more efficient. The paper shows that the proposed analysis method provides an effective and easy way of extracting the residual signal and selecting partials from piano tones. This method is suitable for analysis of recorded piano tones.
Download Neural Audio Processing on Android Phones
This study investigates the potential of real-time inference of neural audio effects on Android smartphones, marking an initial step towards bridging the gap in neural audio processing for mobile devices. Focusing exclusively on processing rather than synthesis, we explore the performance of three open-source neural models across five Android phones released between 2014 and 2022, showcasing varied capabilities due to their generational differences. Through comparative analysis utilizing two C++ inference engines (ONNX Runtime and RTNeural), we aim to evaluate the computational efficiency and timing performance of these models, considering the varying computational loads and the hardware specifics of each device. Our work contributes insights into the feasibility of implementing neural audio processing in real-time on mobile platforms, highlighting challenges and opportunities for future advancements in this rapidly evolving field.