PosEmo – A tool for automatical identification of the involvement and emotional arousal of people in camera images
Project title
PosEmo – A tool for automatical identification of the involvement and emotional arousal of people in camera images
Name of Beneficiary/Beneficiaries
Poznan Supercomputing and Networking Center
affiliated to the Institute of Bioorganic Chemistry of the Polish Academy of Sciences
Name of programme
Domestic programmes
Competition
TANGO V
Project value
PLN 247,500.00
Funding value
PLN 247,500.00
Project delivery period
from 1 March 2022 until 1 May 2023
See the results of our work
The effects of our work can be seen on the project website: https://posemo.io
The validation result for the effectiveness of the PosEmo system was presented at the 57th Hawaii International Conference on System Sciences (HICSS) and is available as an article entitled “PosEmo – An automated system for measuring user interest and attitude in real time”
What problem does our project solve?
The PosEmo project is a response to the limitations of online communication in the area of our expression and non-verbal communication. During video chats conducted with high-quality cameras and monitors and high-bandwidth connections, we do not have the opportunity to fully capture the dynamics of movement of the interlocutors on the other side of the camera. Our expression is limited due to the mere presence of the camera in a particular location often causing us to assume a forced position during the conversation. In the age of the pandemic, we have moved our work, entertainment and learning to the world of video conferencing overnight. We often lost eye contact with our interlocutors and could not observe their facial expressions and body language. We can observe this particularly acutely in meetings with more than five or six participants.
The PosEmo project solves the problem of attitude and engagement analysis, which can have wide applications in education, therapy, research and multimedia content analysis.
It should be emphasised that this is an objective assessment of the content received by the participants in a meeting (or audiovisual content analysis). The greatest accuracy in assessing the interest of the audience can be achieved by using an optimal group size of respondents. The PosEmo system allows automation of the data acquisition process and aggregation of analysis results.
Who will benefit from the project's results?
The main beneficiaries of the project's results will be the creators of educational content provided on online platforms and audio-visual material creators. Researchers conducting studies in the field of psychology and psychophysiology and perception of audio-visual media may use the finished components produced as part of prototype development, both in new research and by using video material recorded during previous studies.
It is possible to use PosEmo as an extension available in the eduMeet open-source video conferencing system, which can be used by psychotherapists communicating with patients via a video conferencing service.