New Artificial Intelligence research from Dr Damien Dupré
New DCU led research into the accuracy of artificial intelligence when it comes to reading emotions on our faces has shown that it still lags behind human observers when it comes to being able to tell whether we’re happy or sad. The difference was particularly pronounced when it came to spontaneous displays of emotion.
The recently published study, A performance comparison of eight commercially available automatic classifiers for facial affect recognition, looked at eight “out of the box” automatic classifiers for facial affect recognition (artificial intelligence that can identify human emotions on faces) and compared their emotion recognition performance to that of human observers.
It found that the human recognition accuracy of emotions was 72% whereas among the artificial intelligence tested, the researchers observed a large variance in recognition accuracy, ranging from 48% to 62%.
The work was conducted by Dr. Damien Dupré from Dublin City University’s Business School, Dr. Eva Krumhuber from the Department of Experimental Psychology at UCL, Dr. Dennis Küster from the Cognitive Systems Lab, University of Bremen and Dr. Gary J. McKeown from the Department of Psychology at Queen’s University Belfast.
937 videos were sampled from two large databases that conveyed the basic six emotions (happiness, sadness, anger, fear, surprise, and disgust).
The study examined both posed and spontaneous emotions.
Results revealed a significant recognition advantage for human observers over automatic classification (72% for human observers)
Among the eight classifiers, there was considerable variance in recognition accuracy ranging from 48% to 62%.
Classification accuracy for AI was consistently lower for spontaneous affective behaviour.
The findings indicate shortcomings of existing out-of-the-box classifiers for measuring emotions.
How the study was done
Two well-known dynamic facial expression databases were chosen: BU-4DFE from Binghamton University in New York and the other from The University of Texas in Dallas.
Both are annotated in terms of emotion categories, and contain either posed or spontaneous facial expressions. All of the examined expressions were dynamic to reflect the realistic nature of human facial behavior.
To evaluate the accuracy of emotion recognition, the study compared the performance achieved by human judges with those of eight commercially available automatic classifiers.
Dr. Damien Dupré said
“AI systems claiming to recognise humans’ emotions from their facial expressions are now very easy to develop. However, most of them are based on inconclusive scientific evidence that people are expressing emotions in the same way.
For these systems, human emotions come down to only six basic emotions, but they do not cope well with blended emotions.
Companies using such systems need to be aware that the results obtained are not a measure of the emotion felt, but merely a measure of how much one’s face matches with a face supposed to correspond to one of these six emotions.”
Co-author Dr. Eva Krumhuber from UCL added
“AI has come a long way in identifying people’s facial expressions, but our research suggests that there is still room for improvement in recognising genuine human emotions.”
Dr. Krumhuber recently led a separate study published in Emotion (also involving Dr. Küster) comparing human vs. machine recognition across fourteen different databases of dynamic facial expressions.
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.