Download Performance-Driven Control for Sample-Based Singing Voice Synthesis
In this paper we address the expressive control of singing voice synthesis. Singing Voice Synthesizers (SVS) traditionally require two types of inputs: a musical score and lyrics. The musical expression is then typically either generated automatically by applying a model of a certain type of expression to a high-level musical score, or achieved by manually editing low-level synthesizer parameters. We propose an alternative method, where the expression control is derived from a singing performance. In a first step, an analysis module extracts expressive information from the input voice signal, which is then adapted and mapped to the internal synthesizer controls. The presented implementation works in an off-line manner processing user input voice signals and lyrics using a phonetic segmentation module. The main contribution of this approach is to offer a direct way of controlling the expression of SVS. The further step is to run the system in real-time. The last section of this paper addresses a possible strategy for real-time operation.
Download The Mellin Pizzicator
In this paper an application of the Mellin transform to the digital audio effects will be presented. Namely, low-pass and band-pass like filtering in the Mellin domain will be described and used for obtaining some kind of pizzicato effect on audio samples (musical instruments, but not only). The pluck and damp effects will be obtained using filtering in Mellin domain only. The algorithm used for implementing the Mellin (scale) transform has been presented in DAFx’04 [1].
Download Expressive Piano Performance Rendering from Unpaired Data
Recent advances in data-driven expressive performance rendering have enabled automatic models to reproduce the characteristics and the variability of human performances of musical compositions. However, these models need to be trained with aligned pairs of scores and performances and they rely notably on score-specific markings, which limits their scope of application. This work tackles the piano performance rendering task in a low-informed setting by only considering the score note information and without aligned data. The proposed model relies on an adversarial training where the basic score notes properties are modified in order to reproduce the expressive qualities contained in a dataset of real performances. First results for unaligned score-to-performance rendering are presented through a conducted listening test. While the interpretation quality is not on par with highly-supervised methods and human renditions, our method shows promising results for transferring realistic expressivity into scores.
Download Spring Reverberation: A Physical Perspective
Spring-based artificial reverberation was one of the earliest attempts at compact replication of room-like reverberation for studio use. The popularity and unique sound of this effect have given it a status and desirability apart from its original use. Standard methods for modeling analog audio effects are not well suited to modeling spring reverberation, due to the complex and dispersive nature of its mechanical vibration. Therefore, new methods must be examined. A typical impulse responses of a spring used for reverberation is examined, and important perceptual parameters identified. Mathematical models of spring vibration are considered, with the purpose of drawing conclusions relevant to their application in an audio environment. These models are used to produce new results relevant to the design of digital systems for the emulation of spring reverberation units. The numerical solution of these models via the finite difference method is considered. A set of measurements of two typical spring reverberation units are presented.
Download Virtual Acoustic Recording: An Interactive Approach
In this paper, we present a framework for recording real musical auditory scenes for interactive virtual acoustic reproduction over headphones. The framework considers the parameterization of real-world soundfields and subsequent real-time auralization using a hybrid image source method/measurement-based auralization approach. First Order (FOA) and Higher Order (HOA) Ambisonics are utilized together in a single system to provide an optimized and psychoacoustically justified framework.
Download Composing Musical Spaces By Means of Decorrelation of Audio Signals
Download Physical Modelling of a Wah-wah Effect Pedal as a Case Study for Application of the Nodal DK Method to Circuits with Variable Parts
The nodal DK method is a systematic way to derive a non-linear state-space system as a physical model for an electrical circuit. Unfortunately, calculating the system coefficients requires inversion of a relatively large matrix. This becomes a problem when the system changes over time, requiring continuous recomputation of the coefficients. In this paper, we present an extension of the DK method to more efficiently handle variable circuit elements. The method is exemplified with the Dunlop Crybaby wah-wah effect pedal, as the continuous change of the potentiometer position is an extremely important aspect of the wah-wah effect.
Download FAUST-STK: a set of linear and nonlinear physical models for the FAUST programming language
The FAUST Synthesis ToolKit is a set of virtual musical instruments written in the FAUST programming language and based on waveguide algorithms and on modal synthesis. Most of them were inspired by instruments implemented in the Synthesis ToolKit (STK) and the program SynthBuilder. Our attention has partly been focused on the pedagogical aspect of the implemented objects. Indeed, we tried to make the FAUST code of each object as optimized and as expressive as possible. Some of the instruments in the FAUST-STK use nonlinear allpass filters to create interesting and new behaviors. Also, a few of them were modified in order to use gesture data to control the performance. A demonstration of this kind of use is done in the Pure Data program. Finally, the results of some performance tests of the generated C++ code are presented.
Download Physical Constraints for the Control of a Physical Model of a Trumpet
In this paper, the control of a physical model of a trumpet is studied. Although this model clearly describes the mechanical and acoustical phenomena that are perceptually relevant, additional constraints must be imposed on the control parameters. In contrast with the model where the tube length can be varied continuously, only seven different tube lengths can be obtained with a real instrument. By studying the physical model and its implementation, different relationships between the control parameters and signal characteristics are identified. These relationships are then used to obtain the best set of tube lengths with respect to a given tuning frequency.
Download Rhythmic expressiveness transformations of audio recordings: swing modifications
In this paper, we propose a computer software for modifying rhythmic performances of polyphonic musical audio signals. It first describes the rhythmic content of an audio signal (i.e. determination of tempi and beat indexes at the quarter-note and eighth-note levels, as well as estimation of the swing ratio). Then, the signal is transformed in real-time using a time-stretch algorithm. We present basic techniques provided by commercial products for swing modification and compare these to our system.