Download FPGA-Enabled Real-Time Audio Sampling, Processing, and Recording for an Electronic Drum Set Processing and recording multitrack audio from an electronic drum set is demanding of computational power and hardware resources. In this paper, we present a complete musical instrument system capable of up to 16-channel percussion sampling, processing, and recording, all in real time. The system leverages a field programmable gate array (FPGA) for parallel audio processing and includes audio effects such as pitch shift, delay, reverb, distortion, a virtual analog low-pass filter, and bit crush. The FPGA also provides interfaces for other system hardware, including an Ethernet audio interface and various audio effect control interfaces. The final design has a cost of under $500 and utilizes about half of the hardware resources on an entry-level FPGA, providing a future platform for more advanced percussion synthesis using real-time physical modeling.
Download Transformer-Based Plate Parameter Estimation with Differentiable and Particle-Swarm Refinement We present two Transformer-based methods for Task A of the 1st DAFx Parameter Estimation Challenge, which requires estimating six effective physical parameters of a synthetic plate-reverb model from its impulse response (IR). Method A1 combines an Audio Spectrogram Transformer encoder and Transformer regressor with differentiable IR refinement. Method A2 uses the same encoder to condition a continuous normalizing flow and refines sampled candidates using particle swarm optimisation (PSO) and gradient polishing. Both methods preserve the absolute IR scale to recover surface density. On a synthetic holdout set of 100 IRs, both refinement procedures reduce waveform and parameter errors by more than three orders of magnitude relative to the unrefined neural outputs. The PSO-based pipeline achieves the lowest errors, indicating near-perfect recovery in this matched synthetic setting.
Download Parameter Estimation via Differentiable Modal Plate Synthesis We present our submission to Task A of the 1st DAFx Parameter Estimation Challenge, which concerns the estimation of the physical parameters of a vibrating plate from a synthetic impulse response. Our approach introduces a differentiable modal plate synthesizer and estimates the plate parameters through inference-time gradient-based optimization of the synthesizer parameters. The six target parameters are recovered by minimizing a multi-scale spectral loss via backpropagation through the differentiable plate model. To handle the non-convexity of the loss landscape, we adopt a two-phase training strategy consisting of multiple short-term probe optimizations, followed by full-scale refinement initialized from the best candidate. We evaluate the approach on eight impulse responses synthesized with the official challenge dataset generator. Compared with a constant-value predictor and the particle swarm optimization baseline provided by the challenge, the proposed method reduces the prediction error by approximately one order of magnitude.
Download DAFx Challenge Introduction & Results The 1st DAFx Parameter Estimation Challenge is an open initiative to advance the state of the art in parameter estimation for acoustic modeling. Stated as a system identification problem, this first edition focuses on plate reverberation—an archetypal dense, modal and weakly damped acoustic system. Participants tackled two tasks: (A) estimating the physical parameters of a vibrating plate from its impulse response, and (B) recovering the modal parameters of the same system. Both rest on a simulation framework based on the damped Kirchhoff–Love plate equation, and both are posed and scored entirely on synthetic data produced by that framework: no measurement of a real plate is involved. Two participants solved Task A down to machine precision by different strategies: one a neural network trained on a very large dataset, and one gradient-free optimization with many inexpensive evaluations. Task B proved considerably harder: the best submission attains a relative error of 0.33 on a [0, 2] scale, and every method recovers modal frequencies and decay rates far more accurately than modal gains. A complementary frequency-domain evaluation reorders the ranking and exposes a systematic gain bias to which the per-mode metric is blind.
Download Neural Networks for Physical Parameter Estimation of Plate Reverberation from Impulse Responses ★ This paper presents our Task A submission to the 1st DAFx Parameter Estimation Challenge. We use the official ModalPlate dataset generator to synthesize 1000 one-second plate impulse responses with randomly sampled parameters inside the public ranges. A time-domain CNN-GRU regressor then estimates the six official Task A parameters from each unnormalised waveform. The model combines three one-dimensional convolutional blocks with a bidirectional gated recurrent unit and is trained with mean squared error on min-max normalised targets. The generated data are split into 700/150/150 train/validation/test examples, and the test split is never used during training or model selection. The implementation follows the official Task A format and exports evaluation-compatible prediction files for both development evaluation and blind-set submission.
Download Multi-Source Extension and Hyperparameter Optimization of the DiffRIR Framework for Room Impulse Response Synthesis Efficient prediction of Room Impulse Responses (RIRs) is a cornerstone for immersive virtual acoustics and scalable room acoustic modeling. This study extends the DiffRIR framework – proposed by Wang et al. in Hearing Anything Anywhere – by introducing a multi-source training logic and systematically optimizing its convergence behavior to overcome the inherent limitations of the original framework. Our results reveal that multi-source training acts as implicit data augmentation, where the resulting increase in spatial entropy enhances the model's spectral accuracy. Furthermore, we demonstrate that the model exhibits remarkable robustness against geometric inaccuracies, maintaining numerical stability even with source positional offsets of up to 4 m in single-source baseline evaluations. By identifying a learning rate of 3×10⁻², we were able to reduce the training duration to 23% of the original baseline without compromising prediction accuracy. While the increased complexity of multi-source fields necessitates a trade-off in temporal precision – quantified via our newly integrated Energy Decay Convergence (EDC) metric – this research provides an efficient and resilient solution for acoustic simulations in complex environments.
Download ALAMODE: Automated Learning of Acoustical Modal Parameters via Differential Evolution This paper is a technical report on the methodology submitted for Task A of the 1st DAFx Parameter Estimation Challenge. The goal of the challenge’s task is to invert the multi-dimensional physical and geometric parameters of a virtual plate reverberator given a target reference impulse response. To achieve this, we present a multi-stage gradient-free optimization framework. This three-stage optimization is computed using an efficient physics-based simulator, starting with an optimization of only mode frequency-determining physical parameters, followed by a 6-DoF parameter optimization with position-determining ones and a final phase for frequency- and position-independent mode amplitude estimation.
Download Simulation-Based Plate-Reverb Parameter Estimation from a Single Impulse Response ★ We present a simulation-trained, non-iterative estimator for Task A of the 1st DAFx Parameter Estimation Challenge. Each unnormalized plate-reverb impulse response is summarized by amplitude, spectral, and decay descriptors, and an ensemble of tree regressors estimates the six target parameters in one pass. Across two independent synthetic validation sets, the normalized models outperform the training-set mean and an earlier raw-regression baseline. On a shared set, the final ensemble also outperforms a single run of the official default PSO at substantially lower inference cost. Since the official labels are hidden, parameter accuracy is measured on simulator-matched data, and the released responses support only audio-side consistency checks. The estimator returns point estimates without uncertainty.
Download Differentiable Articulatory Copy-Synthesis of Biphonic Singing Sygyt is a Tuvan style of biphonic singing in which a low vocal drone is sustained while a high harmonic is selectively amplified in the 1–3 kHz region. Copy-synthesizing this effect remains challenging for articulatory models, since it requires fine control of narrowly focused resonances that standard low-dimensional tract parameterizations cannot easily reproduce. We address this problem with a differentiable Kelly–Lochbaum waveguide augmented with a sublingual second source, cubic B-spline tract parameterization, and spatially varying learnable damping, optimized end-to-end by gradient descent from audio. On 20 segments from two independent sygyt datasets (5 singers, 10 pitches), the proposed model reduces log-spectral distance by 30–38% relative to an articulatory baseline, with the largest gains concentrated in the overtone region. Cepstral-envelope analysis further shows more accurate recovery of the merged formant structure characteristic of sygyt production. The model also outperforms a DDSP harmonic-plus-noise baseline with direct per-harmonic spectral control, suggesting that explicit acoustic structure is a useful inductive bias for overtone-singing copy-synthesis.
Download Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search We describe our submission to Task A of the 1st DAFx parameter estimation challenge. The task is to recover the six physical parameters of a simulated metal-plate reverberator—its dimensions and material properties—from a single impulse response (IR). We treat this as a black-box optimization: candidate parameter sets are fed to the simulator and scored by a loss against the target IR. The method has two stages. The first uses CMA-ES, an evolutionary optimizer, to recover five of the six parameters, comparing IRs under an amplitude-normalized loss. Amplitude normalization makes the search robust but discards the cue to the sixth parameter, the plate’s surface density; a second stage therefore estimates it alone, with a ternary search on the un-normalized loss. As the choice of loss strongly affects the search, we select it beforehand, and analyze why compression in the common multi-scale spectral loss degrades recovery. Finally, we test our method on a validation set of 50 IRs, discuss a pathological failure mode, and ablate to justify having two different stages instead of a unified CMA-ES search.