Researchers teach computer to recognize emotions in speech

09 Nov 2017

1

Experts of the Faculty of Informatics, Mathematics, and Computer Science at the Higher School of Economics (HSE) have created an automatic system capable of identifying emotions in the sound of a voice. Their report was presented at a major international conference - Neuroinformatics-2017.

For a long time, computers have successfully converted speech into text. However, the emotional component, which is important for conveying meaning, has been neglected.

For example, for the same question 'Is everything okay?', people can answer 'Of course it is!' with different intonations - calm, provoking, cheerful, etc. And the reactions will be completely different.

Neural networks are processors connected with each other and capable of learning, analysis and synthesis. This smart system surpasses traditional algorithms in that the interaction between a person and computer becomes more interactive.

HSE researchers Anastasia Popova, Alexander Rassadin and Alexander Ponomarenko have trained a neural network to recognize eight different emotions: neutral, calm, happy, sad, angry, scared, disgusted, and surprised. In 70 per cent of cases the computer identified the emotion correctly, say the researchers.

The researchers have transformed the sound into images - spectrograms - which allowed them to work with sound using the methods applied for image recognition. A deep learning convolutional neural network with VGG-16 architecture was used in the research.

The researchers note that the programme successfully distinguishes neutral and calm tones, while happiness and surprise are not always recognized well. Happiness is often perceived as fear and sadness, and surprise is interpreted as disgust.

Business History Videos

History of hovercraft Part 3...

Today I shall talk a bit more about the military plans for ...

By Kiron Kasbekar | Presenter: Kiron Kasbekar

History of hovercraft Part 2...

In this episode of our history of hovercraft, we shall exam...

By Kiron Kasbekar | Presenter: Kiron Kasbekar

History of Hovercraft Part 1...

If you’ve been a James Bond movie fan, you may recall seein...

By Kiron Kasbekar | Presenter: Kiron Kasbekar

History of Trams in India | ...

The video I am presenting to you is based on a script writt...

By Aniket Gupta | Presenter: Sheetal Gaikwad

view more