Multimodal interaction

This is a new course based on the two previous seminars "Multimodal perception and interaction (INFOMMI)" and "Advanced multimedia systems (INFOAMS)".

Part I will be given by Peter Werkhoven and covers mostly multimodal (multisensory) perception and interaction. This part is about the fascinating world of human visual, auditory and tactile perception and the use of its potential in designing novel interfaces for interacting with virtual worlds. There will be a strong overlap with the INFOMMI seminar (cf. INFOMMI).

Part II will be given by Wolfgang Hürst and covers mostly mobile interaction as one particular example of multimodal interaction. This part is about applying the theoretical background of multimodal perception and multisensory input to concrete state-of-the-art examples, such as mobile gaming on devices like smartphones and tablets. There will only be a small overlap between this part and the INFOAMS seminar.

If you have already taken the INFOAMS seminar, you can still participate in this course. If you have already taken the INFOMMI seminar, you should contact the instructors before registering for this course in order to guarantee that you can get credit for it in your study program.

For further information about this new course please refer to the course's website.

2 weekly lectures plus practicals. The practicals will contain a theoretical part (literature study, game analysis, essay writing and presentation) and a practical part (implementation of a multimodal game or other application).

• Midterm exam (covering part I of the lectures), weighted 25%
• Final exam (covering part II of the lectures), weighted 25%
• Group essay and presentation, weighted 25%
• Project, weighted 25%

• you have to participate in both exams
• you have to deliver all practical assignments
• your average grade from both exams should be at least 5.0 (before rounding)
• your average grade from all practical assignments should be at least 5.0 (before rounding)
• your total grade should be at least 5.5 (before rounding)

If you fail the course you can participate in the retakes (herkansing) if and only if

• you participated in both exams and
• turned in all practical assignments (essay, presentation, and project) and
• your final grade was at least 4.0 (before rounding)

If you failed and your averaged grade from the exams was below 5.0 or your final grade was below 5.5

• you can participate in the retake exam which covers all lectures (part I and II). Your grade from the retake exam will replace the lower grade of the two regular exams if this improves your final grading.

• you can get a new practical assignment. The concrete topic will be decided individually by the instructors. Your grade from this new assignment will replace the lower one of your two grades of the regular practicals (part I or II) if this improves your final grading.

If you passed the course you can also participate in the retake exam if you want to improve your grade.

• The retake exam covers all lectures (part I and II).
• Your grade from the retake exam will replace the lower grade of the two regular exams if and only if this improves your final grade.
• If you are planning to take advantage of this, please inform the coordinator of this course by email about this. Note that this has just organizational reasons (how many exams to print, ...), but there are no consequences if you change your mind, etc.