Download Sound Analysis and Synthesis Adaptive in Time and Two Frequency Bands We present an algorithm for sound analysis and resynthesis with local automatic adaptation of time-frequency resolution. There exists several algorithms allowing to adapt the analysis window depending on its time or frequency location; in what follows we propose a method which select the optimal resolution depending on both time and frequency. We consider an approach that we denote as analysis-weighting, from the point of view of Gabor frame theory. We analyze in particular the case of different adaptive timevarying resolutions within two complementary frequency bands; this is a typical case where perfect signal reconstruction cannot in general be achieved with fast algorithms, causing a certain error to be minimized. We provide examples of adaptive analyses of a music sound, and outline several possibilities that this work opens.
Download Digital Grey Box Model of the Uni-Vibe Effects Pedal This paper presents a digital grey box model of a late 1960s era Shin-ei Uni-Vibe(r) 1 analog effects foot pedal. As an early phase shifter, it achieved wide success in popular music as a unique musical effect, noteworthy for its pulsating and throbbing modulation sounds. The Uni-Vibe is an early series all-pass phaser effect, where each first-order section is a discrete component phase splitter (no operational amplifiers). The dynamic sweeping movement of the effect arises from a single LFO-driven incandescent lamp opto-coupled to the light dependent resistors (LDRs) of each stage. The proposed method combines digital circuit models with measured LDR characteristics for the four phase shift stages of an original Uni-Vibe unit, resulting in an efficient emulation that preserves the character of the Uni-Vibe. In modeling this iconic effect, we also aim to offer some historical and technical insight into the exact nature of its unique sound.
Download Hyper Recurrent Neural Network: Condition Mechanisms for Black-Box Audio Effect Modeling Recurrent neural networks (RNNs) have demonstrated impressive results for virtual analog modeling of audio effects. These networks process time-domain audio signals using a series of matrix multiplication and nonlinear activation functions to emulate the behavior of the target device accurately. To additionally model the effect of the knobs for an RNN-based model, existing approaches integrate control parameters by concatenating them channel-wisely with some intermediate representation of the input signal. While this method is parameter-efficient, there is room to further improve the quality of generated audio because the concatenation-based conditioning method has limited capacity in modulating signals. In this paper, we propose three novel conditioning mechanisms for RNNs, tailored for black-box virtual analog modeling. These advanced conditioning mechanisms modulate the model based on control parameters, yielding superior results to existing RNN- and CNN-based architectures across various evaluation metrics.
Download A hybrid approach to timbral consistency in a virtual instrument The aim of this work is to make an instrument that is timbrally consistent over pitch and loudness. This particular work is not attempting to reproduce an existing instrument’s timbre, but to produce a timbrally dynamic virtual instrument that can be designed by the user. In this paper there is a brief introduction to timbre and synthesis methods, followed by a proposal on how to make timbrally consistent virtual instruments out of given timbres.
Download A Finite Difference Model for Articulated Slide-String Simulation Slide-string instruments allow continuous control of pitch by articulation with a slide object whose position of contact with the
string is time-varying. This paper presents a method for simulation of such articulation. Taking into account sensing and musical
practice considerations, an appropriate physical model configuration is determined, which is then formulated in numerical form
using a finite difference approach. The model simulates the attachment and detachment phases of slide articulation which generally involve rattling, while finger damping is modelled in a more
phenomenological manner as a regionally induced time-varying
damping. A stability bound for the numerical model is provided
via energy analysis, which also reveals the driving power contributions of the separate articulatory sources. The approach is exemplified with simulations of slide articulatory gestures that involve
glissando, vibrato and finger damping.
Download Recent developments in PWSYNTH PWSynth was originally a visual synthesis language situated in PatchWork. Recently our research team has started a complete rewrite of the system so that it can be adapted to our new programming environment called PWGL. In this paper we present the main differences of the old and new systems. These include switching from C to C++, efficiency issues, interface between PWGL and the synthesis engine, and a novel copy-synth-patch scheme.
Download Neural Networks for Physical Parameter Estimation of Plate Reverberation from Impulse Responses ★ This paper presents our Task A submission to the 1st DAFx Parameter Estimation Challenge. We use the official ModalPlate dataset generator to synthesize 1000 one-second plate impulse responses with randomly sampled parameters inside the public ranges. A time-domain CNN-GRU regressor then estimates the six official Task A parameters from each unnormalised waveform. The model combines three one-dimensional convolutional blocks with a bidirectional gated recurrent unit and is trained with mean squared error on min-max normalised targets. The generated data are split into 700/150/150 train/validation/test examples, and the test split is never used during training or model selection. The implementation follows the official Task A format and exports evaluation-compatible prediction files for both development evaluation and blind-set submission.
Download Analysis-and-manipulation approach to pitch and duration of musical instrument sounds without distorting timbral characteristics This paper presents an analysis-manipulation method that can generate musical instrument sounds with arbitrary pitches and durations from the sound of a given musical instrument (called seed) without distorting its timbral characteristics. Based on psychoacoustical knowledge of the auditory effects of timbres, we defined timbral features based on the spectrogram of the sound of a musical instrument as (i) the relative amplitudes of the harmonic peaks, (ii) the distribution of the inharmonic component, and (iii) temporal envelopes. First, to analyze the timbral features of a seed, it was separated into harmonic and inharmonic components using Itoyama’s integrated model. For pitch manipulation, we took into account the pitch-dependency of features (i) and (ii). We predicted the values of each feature by using a cubic polynomial that approximated the distribution of these features over pitches. To manipulate duration, we focused on preserving feature (iii) in the attack and decay duration of a seed. Therefore, only steady durations were expanded or shrunk. In addition, we propose a method for reproducing the properties of vibrato. Experimental results demonstrated the quality of the synthesized sounds produced using our method. The spectral and MFCC distances between the synthesized sounds and actual sounds of 32 instruments were reduced by 64.70% and 32.31%, respectively.
Download Energy-based synthesis of tension modulation in strings Above a certain amplitude, the string vibration becomes nonlinear due to the variation of tension. An important special case is when the tension varies with time but spatially uniform along the string. The most important effect of this tension modulation is the exponential decay of the pitch (pitch glide). In the case of nonrigid string termination, the generation of double frequency terms and the excitation of missing modes also occurs, but this is perceptually less relevant for most of the cases. Several modeling strategies have been developed for tension modulated strings. However, their computational complexity is significantly higher compared to linear string models. This paper proposes efficient techniques for modeling the quasistatic part (short-time average) of the tension variation that gives rise to the most relevant pitch glide effect. The modeling is based on the linear relationship between the energy of the string and quasistatic tension variation. When this feature is added to linear string models, the computational complexity is increased by a negligible amount, leading to significant savings compared to earlier tension modulated string models.