Download Simulating Idiomatic Playing Styles in a Classical Guitar Synthesizer: Rasgueado as a Case Study This paper presents our research efforts to synthesize complex instrumental gestures using a score-based control scheme. Our specific goal is to simulate the rasgueado technique that is popular especially in flamenco music. This technique is also used in the classical guitar repertoire. Rasgueado is especially challenging as ordinary music notation is not adequate to represent the dense stream of notes required for a convincing simulation. We will take two approaches to realize our task. First, we use the practical knowledge of how the actual performance is accomplished by the human player. A second, complementary, approach is to analyze an excerpt from real guitar playing. Our main focus here is to extract the onset times and the amplitudes of the recoded gesture. Next we combine the results from the two analysis steps using a constraintbased approach to find possible pitch and fingering sequences. Finally we translate the findings to our macro-note scheme that allows us to fill algorithmically a musical score.
Download Neural Grey-Box Guitar Amplifier Modelling with Limited Data This paper combines recurrent neural networks (RNNs) with the discretised Kirchhoff nodal analysis (DK-method) to create a grey-box guitar amplifier model. Both the objective and subjective results suggest that the proposed model is able to outperform a baseline black-box RNN model in the task of modelling a guitar amplifier, including realistically recreating the behaviour of the amplifier equaliser circuit, whilst requiring significantly less training data. Furthermore, we adapt the linear part of the DK-method in a deep learning scenario to derive multiple state-space filters simultaneously. We frequency sample the filter transfer functions in parallel and perform frequency domain filtering to considerably reduce the required training times compared to recursive state-space filtering. This study shows that it is a powerful idea to separately model the linear and nonlinear parts of a guitar amplifier using supervised learning.
Download Dispersion Modeling in Waveguide Piano Synthesis Using Tunable Allpass Filters This paper extends a previously proposed method for designing filters simulating the dispersion phenomenon occurring in string instruments. In digital waveguide synthesis, the phenomenon is traditionally modeled by inserting an allpass filter to the string model feedback loop. In this paper, the concept of tunable dispersion filter design, which provides a closed-form formula to design a dispersion filter, is applied to a cascade of first-order allpass filters. Moreover, the method is extended to design a filter cascade including an arbitrary number of first-order filters. In addition, it is shown how the designed dispersion filter can be used in a waveguide piano synthesis model.
Download Differentiable Active Acoustics - Optimizing Stability via Gradient Descent Active acoustics (AA) refers to an electroacoustic system that actively modifies the acoustics of a room. For common use cases, the number of transducers—loudspeakers and microphones—involved in the system is large, resulting in a large number of system parameters. To optimally blend the response of the system into the natural acoustics of the room, the parameters require careful tuning, which is a time-consuming process performed by an expert. In this paper, we present a differentiable AA framework, which allows multi-objective optimization without impairing architecture flexibility. The system is implemented in PyTorch to be easily translated into a machine-learning pipeline, thus automating the tuning process. The objective of the pipeline is to optimize the digital signal processor (DSP) component to evenly distribute the energy in the feedback loop across frequencies. We investigate the effectiveness of DSPs composed of finite impulse response filters, which are unconstrained during the optimization. We study the effect of multiple filter orders, number of transducers, and loss functions on the performance. Different loss functions behave similarly for systems with few transducers and low-order filters. Increasing the number of transducers and the order of the filters improves results and accentuates the difference in the performance of the loss functions.
Download Flutter Echo Modeling Flutter echo is a well-known acoustic phenomenon that occurs when sound waves bounce between two parallel reflective surfaces, creating a repetitive sound. In this work, we introduce a method to recreate flutter echo as an audio effect. The proposed algorithm is based on a feedback structure utilizing velvet noise that aims to synthesize the fluttery components of a reference room impulse response presenting flutter echo. Among these, the repetition time defines the length of the delay line in a feedback filter. The specific spectral properties of the flutter are obtained with a bandpass attenuation filter and a ripple filter, which enhances the harmonic behavior of the sound. Additional temporal shaping of a velvet-noise filter, which processes the output of the feedback loop, is performed based on the properties of the reference flutter. The comparison between synthetic and measured flutter echo impulse responses shows good agreement in terms of both the repetition time and reverberation time values.
Download Spectral Dealy Filters with Feedback Delay Filters with Feedback and Time-Varying Coefficients A recently introduced structure to implement a continuously smooth spectral delay, based on a cascade of first-order allpass filters and an equalizing filter, is described and the properties of this spectral delay filter are reviewed. A new amplitude envelope equalizing filter for the spectral delay filter is proposed and the properties of structures utilizing feedback and/or time-varying filter coefficients are discussed. In addition, the stability conditions for the feedback and the time-varying structures are derived. A spectral delay filter can be used for synthesizing chirp-like sounds or for modifying the timbre of arbitrary audio signals. Sound examples on the use of the spectral delay filters utilizing the structures discussed in this paper can be found at http://www.acoustics.hut. fi/publications/papers/dafx09-sdf/.
Download Time-Variant Gray-Box Modeling of a Phaser Pedal A method to measure the response of a linear time-variant (LTV) audio system is presented. The proposed method uses a series of short chirps generated as the impulse response of several cascaded allpass filters. This test signal can measure the characteristics of an LTV system as a function of time. Results obtained from testing of this method on a guitar phaser pedal are presented. A proof of concept gray-box model of the measured system is produced based on partial knowledge about the internal structure of the pedal and on the spectral analysis of the measured responses. The temporal behavior of the digital model is shown to be very similar to that of the measured device. This demonstrates that it is possible to measure LTV analog audio systems and produce approximate virtual analog models based on these results.
Download More Acoustic Sounding Timbre From Guitar Pickups Amplified guitars with pickups tend to sound ’dry’ and electric, whether the instrument is acoustic or electric. Vibration or pressure sensing pickups for acoustic guitars do not capture the body vibrations with fidelity and in the electric guitar with magnetic pickups there often is no resonating body at all. Especially with an acoustic guitar there is a need to reinforce the sound by retaining the natural acoustic timbre. In this study we have explored the use of DSP equalization to make the signal from the pickup sound more acoustic. Both acoustic and electric guitar pickups are studied. Different digital filters to simulate acoustic sound are compared, and related estimation techniques for filter parameters are discussed.
Download A Virtual Tube Delay Effect A virtual tube delay effect based on the real-time simulation of acoustic wave propagation in a garden hose is presented. The paper describes the acoustic measurements conducted and the analysis of the sound propagation in long narrow tubes. The obtained impulse responses are used to design delay lines and digital filters, which simulate the propagation delay, losses, and reflections from the end of the tube which may be open, closed, or acoustically attenuated. A study on the reflection caused by a finite-length tube is described. The resulting system consists of a digital waveguide model and produces delay effects having a realistic low-pass filtering. A stereo delay effect plugin in P URE DATA1 has been implemented and it is described here.
Download Neural Modelling of Time-Varying Effects This paper proposes a grey-box neural network based approach
to modelling LFO modulated time-varying effects.
The neural
network model receives both the unprocessed audio, as well as
the LFO signal, as input. This allows complete control over the
model’s LFO frequency and shape. The neural networks are trained
using guitar audio, which has to be processed by the target effect
and also annotated with the predicted LFO signal before training.
A measurement signal based on regularly spaced chirps was used
to accurately predict the LFO signal. The model architecture has
been previously shown to be capable of running in real-time on a
modern desktop computer, whilst using relatively little processing
power. We validate our approach creating models of both a phaser
and a flanger effects pedal, and theoretically it can be applied to
any LFO modulated time-varying effect. In the best case, an errorto-signal ratio of 1.3% is achieved when modelling a flanger pedal,
and previous work has shown that this corresponds to the model
being nearly indistinguishable from the target device.