Driver Emotion Recognition for Safe Driving: A Comprehensive Survey

Abstract

Accidents on roads have been a serious issue for decades in the world. As a solution to this issue, driver emotion recognition has gained much attention where the affective states of the drivers are monitored. In the context of driver emotion recognition, both the physiological and non-physiological signals are utilised in identifying the emotional states of the drivers. Among the approaches taken by researchers in determining the driver emotional states facial emotions, speech emotions, Galvanic Skin Response (GSR), Electrocardiogram (ECG) signals, Electroencephalography (EEG) signals, etc., are much more prominent. Nevertheless, physiological signals are a valuable asset in identifying the emotional states since non- physiological signals such as facial emotion recognition, that is mainly used to detect driver affective states, can be misleading. This study aims to review the literature related to driver emotion recognition that aims on ensuring the safety of road users. Furthermore, the approaches taken by the researchers in the reviewed literature have been briefly discussed, and the challenges to these approaches have been further discussed to enhance the safety of road users and future research in the paradigm of driver emotion recognition.