Sound And Music Technology (INFOMSMT) 2017-2018

Sound and Music Technology

2017-18

Master Program Game & Media Technology

Introduction

Sound and music provide powerful ways for impacting the human experience involved in the engagement with games and media. For instance, they are of crucial importance for the interactive and immersive qualities of games, which are key aspects in making games worthwhile to play. Sound and music are also crucial in the context of media technology.In order to enhance users’ experiences when listening to, interacting with and searching for music from large collections of digitized music that became available over recent decades, new technologies for processing digitized music and sound information need to be developed.

Lecturer of this course is Anja Volk.

General description of the course

In this course, you will learn how to apply and develop computational methods to extract, process and utilize music information from digital sound and music in the context of newly emerging research areas within games and media. You will learn how sound and music information is crucial for the human experience, and how the computational modelling of sound and music contributes to the enrichment of this experience in games and media. This encompasses that you will get to know both basic concepts on how human listeners extract, make sense of and give meaning to information from sound and music, and how these basic concepts are used, researched and applied through computational technology.

The course is structured around three main modules:

  1. Sound and music for games
  2. Analysis, classification, and retrieval of sound and music for media
  3. Generation and manipulation of sound and music for games and media

The course will cover key topics for sound and music technology in the context of games and media, such as interactivity and immersion in games through sound and music (A), classification and retrieval of similar musical objects in multimedia (B), and the utilization of the emotional and affective qualities of music in games and media (A, C). You will learn what specific technologies are developed and required within these key topics, such as automatic pattern discovery, sound separation, voice separation, automatic segmentation, and feature extraction and manipulation (B). For studying, discussing and employing these technologies you will get to know different representation forms of music information in audio and symbolic data (A), different musical dimensions such as melody, rhythm, harmony, timbre and loudness (A, B), and how they are modelled through computational features (A, B, C). Moreover, you will learn about different general strategies for developing computational models for sound and music processing, such as model-based versus data-driven approaches, and about the challenges of evaluating these models.

A more detailed description of the content of the three main modules is given in the Week-by-week guide below.

Learning objectives of the course

During the course you require basic knowledge and understanding of different aspects of musical information, such as melodic, rhythmic, harmonic and timbral information. At the end of the course you will be able to address the specific challenges involved in modelling these aspects of music information for key topics in sound and media technology. You will be able to evaluate the pro’s and con’s of different state-of-the-art techniques developed for specific important tasks in games and media. Moreover, you will be able to reflect on the potential of selected computational methods for modelling specific aspects of sound and music in the games and media context, to discuss perspectives of improvements in current computational approaches, and to apply your knowledge about these techniques in a creative manner within a final project.

After module A you will be able to:

After module B you will be able to:

After module C you will be able to: