基于光流方向信息熵統計的微表情捕捉
Capture of microexpressions based on the entropy of oriented optical flow
-
摘要: 以光流法為依據,提出了一種基于光流方向信息熵(entropy of oriented optical flow,EOF)統計的方法捕捉微表情關鍵幀.首先,采用改進的Horn-Schunck光流法提取視頻流中相鄰兩幀圖像的微表情運動特征;其次,采用閾值分析法篩選出投影速度模值較大的光流向量;之后,采用圖像信息熵統計光流變化角度,進而得到視頻序列的方向信息熵向量,通過對熵向量的分析,實現微表情關鍵幀捕捉;最后,本實驗采用芬蘭奧盧大學的SMIC微表情數據庫和中國科學院心理研究所傅小蘭的CASME微表情數據庫作為實驗樣本,通過與傳統的幀差法比較,證明了本文提出的算法優于幀差法,能夠較好地表現出微表情變化趨勢,為微表情識別提供基礎.Abstract: This paper proposes an algorithm that is effective in detecting the key frame of microexpression based on the entropy of oriented optical flow. Initially, this paper used an improved Horn-Schunck optical flow to extract the motion features of adjacent frames. Then, the threshold algorithm was used to filter the optical flow vectors with high-projective modulus. To capture the key frame of microexpression, the paper used information entropy to count the direction of optical flow vectors and analyzed the changing of microexpressions using an entropy vector of video sequences. Finally, the algorithm in this paper was verified with microexpression database SMIC (Oulu University) and CASME (the Director of the Institute of Psychology at the Chinese Academy of Sciences, Fu Xiaolan). Compared with traditional frame differences, experiments show that the algorithm is good not only in expressing the trend of the microexpression but also in providing the basis for microexpression recognition.