Download Neural Parametric Equalizer Matching Using Differentiable Biquads This paper proposes a neural network for carrying out parametric equalizer (EQ) matching. The novelty of this neural network
solution is that it can be optimized directly in the frequency domain by means of differentiable biquads, rather than relying solely
on a loss on parameter values which does not correlate directly
with the system output. We compare the performance of the proposed neural network approach with that of a baseline algorithm
based on a convex relaxation of the problem. It is observed that the
neural network can provide better matching than the baseline approach because it directly attempts to solve the non-convex problem. Moreover, we show that the same network trained with only
a parameter loss is insufficient for the task, despite the fact that it
matches underlying EQ parameters better than one trained with a
combination of spectral and parameter losses.
Download Alloy Sounds: Non-Repeating Sound Textures With Probabilistic Cellular Automata Contemporary musicians commonly face the challenge of finding
new, characteristic sounds that can make their compositions more
distinct. They often resort to computers and algorithms, which can
significantly aid in creative processes by generating unexpected
material in controlled probabilistic processes. In particular, algorithms that present emergent behaviors, like genetic algorithms
and cellular automata, have fostered a broad diversity of musical explorations. This article proposes an original technique for
the computer-assisted creation and manipulation of sound textures.
The technique uses Probabilistic Cellular Automata, which are yet
seldom explored in the music domain, to blend two audio tracks
into a third, different one. The proposed blending process works
by dividing the source tracks into frequency bands and then associating each of the automaton’s cell to a frequency band. Only one
source, chosen by the cell’s state, is active within each band. The
resulting track has a non-repeating textural pattern that follows the
changes in the Cellular Automata. This blending process allows
the musician to choose the original material and the blend granularity, significantly changing the resulting blends. We demonstrate
how to use the proposed blending process in sound design and its
application in experimental and popular music.
Download On the Nonlinear Commuted Synthesis of the Piano In this paper a novel method is presented for the physics-based sound synthesis of the piano, based on digital waveguides. The approach combines the advantages of the commuted synthesis technique and the methods using a nonlinear hammer model. The interaction force of the hammer-string contact is computed by an auxiliary digital waveguide connected to a nonlinear hammer model. This force signal is used as a target impulse response for designing a low-order digital filter real-time. The piano sound is calculated by filtering the soundboard response with the hammer filter and feeding this signal to a synthesizer digital waveguide. A new method is presented for separating the contribution of the interaction force and the soundboard in measured piano tones. For modeling beating, a new technique is proposed based on a simplified pitch-shift effect. Considerations on modeling the effect of sustain pedal are also given. It is shown that the technique of designing the hammer filter real-time is not only useful for digital waveguide modeling, but it can be combined with sampling synthesis too.
Download An Interdisciplinary Approach to Audio Effect Classification The aim of this paper is to propose an interdisciplinary classification of digital audio effects to facilitate communication and collaborations between DSP programmers, sound engineers, composers, performers and musicologists. After reviewing classifications reflecting technological, technical and perceptual points of view, we introduce a transverse classification to link disciplinespecific classifications into a single network containing various layers of descriptors, ranging from low-level features to high-level features. Simple tools using the interdisciplinary classification are introduced to facilitate the navigation between effects, underlying techniques, perceptual attributes and semantic descriptors. Finally, concluding remarks on implications for teaching purposes and for the development of audio effects user interfaces based on perceptual features rather than technical parameters are presented.
Download Informed Source Separation for Stereo Unmixing — An Open Source Implementation Active listening consists in interacting with the music playing and has numerous potential applications from pedagogy to gaming, through creation. In the context of music industry, using existing musical recordings (e.g. studio stems), it could be possible for the listener to generate new versions of a given musical piece (i.e. artistic mix). But imagine one could do this from the original mix itself. In a previous research project, we proposed a coder / decoder scheme for what we called informed source separation: The coder determines the information necessary to recover the tracks and embeds it inaudibly (using watermarking) in the mix. The decoder enhances the source separation with this information. We proposed and patented several methods, using various types of embedded information and separation techniques, hoping that the music industry was ready to give the listener this freedom of active listening. Fortunately, there are numerous other applications possible, such as the manipulation of musical archives, for example in the context of ethnomusicology. But the patents remain for many years, which is problematic. In this article, we present an open-source implementation of a patent-free algorithm to address the mixing and unmixing audio problem for any type of music.
Download GPGPU Audio Benchmark Framework Acceleration of audio workloads on generally-programmable GPU (GPGPU) hardware offers potentially high speedup factors, but also presents challenges in terms of development and deployment. We can increasingly depend on such hardware being available in users’ systems, yet few real-time audio products use this resource. We propose a suite of benchmarks to qualify a GPU as suitable for batch or real-time audio processing. This includes both microbenchmarks and higher-level audio domain benchmarks. We choose metrics based on application, paying particularly close attention to latency tail distribution. We propose an extension to the benchmark framework to more accurately simulate the real-world request pattern and performance requirements when running in a digital audio workstation. We run these benchmarks on two common consumer-level platforms: a PC desktop with a recent midrange discrete GPU and a Macintosh desktop with unified CPUGPU memory architecture.
Download Simplifying Antiderivative Antialiasing with Lookup Table Integration Antiderivative Antialiasing (ADAA), has become a pivotal method
for reducing aliasing when dealing with nonlinear function at audio rate. However, its implementation requires analytical computation of the antiderivative of the nonlinear function, which in practical cases can be challenging without a symbolic solver. Moreover, when the nonlinear function is given by measurements it
must be approximated to get a symbolic description. In this paper, we propose a simple approach to ADAA for practical applications that employs numerical integration of lookup tables (LUTs)
to approximate the antiderivative. This method eliminates the need
for closed-form solutions, streamlining the ADAA implementation
process in industrial applications. We analyze the trade-offs of this
approach, highlighting its computational efficiency and ease of implementation while discussing the potential impact of numerical
integration errors on aliasing performance. Experiments are conducted with static nonlinearities (tanh, a simple wavefolder and
the Buchla 259 wavefolding circuit) and a stateful nonlinear system (the diode clipper).
Download Real-Time Virtual Analog Modelling of Diode-Based VCAs Some early analog voltage-controlled amplifiers (VCAs) utilized
semiconductor diodes as a variable-gain element. Diode-based
VCAs exhibit a unique sound quality, with distortion dependent
both on signal level and gain control. In this work, we examine the
behavior of a simplified circuit for a diode-based VCA and propose
a nonlinear, explicit, stateless digital model. This approach avoids
traditional iterative algorithms, which can be computationally intensive. The resulting digital model retains the sonic characteristics
of the analog model and is suitable for real-time simulation. We
present an analysis of the gain characteristics and harmonic distortion produced by this model, as well as practical guidance for
implementation. We apply this approach to a set of alternative
analog topologies and introduce a family of digital VCA models
based on fixed nonlinearities with variable operating points.
Download On Iterative Solutions for Numerical Collision Models Nonlinear interactions between different parts of musical instruments present several challenges regarding the formulation of reliable and efficient numerical sound synthesis models. This paper focuses on a numerical collision model that incorporates impact damping. The proposed energy-based approach involves an iterative solver for the solution of the nonlinear system equations. In order to ensure the efficiency of the presented algorithm a bound is derived for the maximum number of iterations required for convergence. Numerical results demonstrate energy conservation as well as convergence within a small number of iterations, which is usually much lower than the predicted bound. Finally, an application to music acoustics, involving a clarinet simulation, shows that including a loss mechanism during collisions may have a significant effect on sound production.
Download Music Emotion Classification: Dataset Acquisition And Comparative Analysis In this paper we present an approach to emotion classification in audio music. The process is conducted with a dataset of 903 clips and mood labels, collected from Allmusic1 database, organized in five clusters similar to the dataset used in the MIREX2 Mood Classification Task. Three different audio frameworks – Marsyas, MIR Toolbox and Psysound, were used to extract several features. These audio features and annotations are used with supervised learning techniques to train and test various classifiers based on support vector machines. To access the importance of each feature several different combinations of features, obtained with feature selection algorithms or manually selected were tested. The performance of the solution was measured with 20 repetitions of 10-fold cross validation, achieving a F-measure of 47.2% with precision of 46.8% and recall of 47.6%.