Musical Computer Games Played by Singing

Perttu Hämäläinen; Teemu Mäki-Patola; Ville Pulkki; Matti Airas
DAFx-2004 - Naples
Although voice has been used as an input modality in various user interfaces, there are no reports of using pitch of the user’s voice for real-time control of computer games. This paper explores pitch-based control for novel games for musical education. Mapping pitch to the position of a game character provides visual feedback that helps you to learn to control your voice and sing in tune. As demonstrated by two example games in this paper, the approach can be applied to both single and two-player games even with just one microphone.
Download