Download A String in a Room: Mixed-Dimensional Transfer Function Models for Sound Synthesis
Physical accuracy of virtual acoustics receives increasing attention due to renewed interest in virtual and augmented reality applications. So far, the modeling of vibrating objects as point sources is a common simplification which neglects effects caused by their spatial extent. In this contribution, we propose a technique for the interconnection of a distributed source to a room model, based on a modal representation of source and room. In particular, we derive a connection matrix that describes the coupling between the modes of the source and the room modes in an analytical form. Therefore, we consider the example of a string that is oscillating in a room. Both, room and string rely on well established physical descriptions that are modeled in terms of transfer functions. The derived connection of string and room defines the coupling between the characteristic string and room modes. The proposed structure is analyzed by numerical evaluations and sound examples on the supplementary website.
Download Physical Modeling Using Recurrent Neural Networks with Fast Convolutional Layers
Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or partial differential equations, using established techniques. Recent work has applied the techniques of machine-learning to construct such models automatically from data for the case of systems which have lumped states described by scalar values, such as electrical circuits. In this work, we examine how similar techniques are able to construct models of systems which have spatially distributed rather than lumped states. We describe several novel recurrent neural network structures, and show how they can be thought of as an extension of modal techniques. As a proof of concept, we generate synthetic data for three physical systems and show that the proposed network structures can be trained with this data to reproduce the behavior of these systems.