Master Seminar "Advanced Methods for Emotion Recognition in Highly Automated Driving"

Organizer: M.Sc. Sina Shafaei

Contact: shafaei (at)

Modul: IN2107

Registration: Via Matching System and Submitted Application

Type: MasterSeminar

Semester: Summer Semester 2019

ECTS: 5.0/4.0

Target Group: Highly motivated master students

Time & Location: 02.09.023 / 13:00-15:00 (only presentation dates)



  • Slides of the Introductory Session (26.04.2019): Here

  • The first official session of the seminar, for the registered students, will be on 26.04.2019

  • Interested applicants must send an email to "shafaei(at)" (set the subject of your email to: AMER) with a copy of their CV and a brief motivation for this seminar, latest by 11.02.2019. All of the applications will be examined carefully and the selected candidates will be notified on 12.02.2019 over the email in order to set this seminar as their "first" priority in matching system.

  • There is no preliminary (pre-course) session for this seminar, registration is only possible by submitting an application of interest over email and via matching system


Students will investigate the role and the future of the emotion recognition in the era of fully automated cars, along with the fundamental challenges, approaches and tools for maintaining the emotional awareness not only inside the cabin but also the environment around the car. Moreover, different scenarios and applications which are of interest will be examined and future research directions will be enlightened by the end of this seminar.


In our first session on 26.04.2019 students will form their group (of two members) and we will discuss the available topics. Each group will get one topic according to their own preference. Groups will collect the necessary materials (state-of-the-art scientific works like scientific publications) within the context of their topic and will perform their research based on the collected resources in order to find a proper solution for the research question(s) in their topics.

For demonstrating the validity of their findings, each group will develop their findings and proposals into a "Multimodal Emotion Recognition System" which is already developed in our group on the SMART car simulator (and will be provided to them by the seminar organizer) and should be able to represent the results they have achieved live on the system.

Each group will be given 40 minutes on their specified date (are listed in below) to represent the results and afterwards will write and submit a scientific paper (IEEE template) with minimum 6 pages, explaining their findings and the main contribution of their work during seminar.

                                  TopicsPresentation (Date)Sides
A- Illumination Resisted Approaches for Emotion Recognition Systems28.06.2019Download
B- Driver Behavior Modeling and Fusion Approaches for Emotion Recognition Systems28.06.2019 Download
C- Thermal Imaging and Emotion Classification for In Cabin Environment05.07.2019 Download
D- Eye Gaze Modeling of Driver and Passengers (level 3, 4 and 5) for Emotion Recognition Systems05.07.2019 Download
E- Emotion Classification using LSTM Based on Driving Behavior 12.07.2019 Download
F- Emotion Classification using CNN Based on Driving Behavior12.07.2019Download
G- Recurrent Neural Network Architectures for Emotion Classification in Multimodal Emotion Recognition Systems19.07.2019 Download
H- Maintaining Prediction Robustness of the Multimodal Emotion Recognition Systems19.07.2019Download