立體視頻延時的事件相關電位研究

沈麗麗; 吳子陽

doi:10.13374/j.issn2095-9389.2018.04.015

立體視頻延時的事件相關電位研究

doi: 10.13374/j.issn2095-9389.2018.04.015

沈麗麗^,,
吳子陽

天津大學電氣自動化與信息工程學院, 天津 300072

基金項目:

國家自然科學基金資助項目(61520106002,61302123)

詳細信息

中圖分類號: R318
計量
- 文章訪問數: 687
- HTML全文瀏覽量: 225
- PDF下載量: 7
- 被引次數: 0
出版歷程
- 收稿日期: 2017-07-20

Study of asynchronous stereoscopic video based on event related potentials

SHEN Li-li^,,
WU Zi-yang

School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China

摘要

摘要: 立體視頻在無質量保證的互聯網上傳輸時會引發立體視頻左右視圖的幀延時,影響觀看質量.本文提出一種利用主觀評價與客觀腦電(electroencephalogram,EEG)相結合的方式分別對深度和水平延時運動立體視頻刺激進行分析,并對二者的差異性進行比較.共有十名被試參加實驗,被試觀看隨機呈現的不同延時等級包括無延時、延時1幀、延時2幀和延時3幀的立體視頻片段,并對是否感知到延時效應做出主觀判斷,同時記錄被試的EEG信號.從EEG信號中提取出事件相關電位(event related potentials,ERPs)并結合主觀行為數據進行分析與比較.實驗結果表明,為保證觀看質量,深度運動立體視頻中所能存在的最大延時幀數為1幀,水平運動中則不能存在延時效應.與水平延時運動相比,深度延時運動刺激產生的P300成分幅值變化范圍更大,表明在深度延時運動刺激下大腦的活躍程度更高.同時,相同延時幀數的深度運動與水平運動刺激所產生的P300成分中,深度延時運動的潛伏期更長,這表明處理深度延時運動刺激所需時間更長.
- 立體視頻 /
- 幀延時 /
- 事件相關電位 /
- 深度運動 /
- 水平運動 /
- 差異性
Abstract: When stereoscopic videos are transmitted on the no-quality-assurance internet, frame delay occurs in the left and right views, which affect the stereoscopic sensation as well as the viewing quality. In this paper, the stimulus of motion-in-depth and motionin-lateral asynchronous stereoscopic videos were analyzed and they were compared via qualitative and quantitative assessments. In this quantitative experiments, the well-known electroencephalogram (EEG) was utilized. A total of ten subjects was recruited to participate in an experiment, in which they watched randomly presented asynchronous stereoscopic video clips. For the qualitative assessment, after viewing one clip, the subjects were asked whether they perceived any asynchronicity in the frames. The degrees of asynchronicity included no delay, one frame delay, two frame delay, and three frame delay. The electroencephalogram (EEG) signal of each subject was recorded as they viewed the clip. Next, the event-related potentials (ERPs) were extracted from the EEG signals and the behavioral data and the ERPs were analyzed to compare the different reactions to the depths and lateral extents of the asynchronous stereoscopic motion. The results reveal that the maximum allowable asynchronicity perceived for motion-in-depth stereoscopic video clips is one frame, whereas there must be no delay in the motion-in-lateral stereoscopic video clips. In addition, compared with being stimulated by the motion-in-lateral asynchronous stereoscopic video clips, a magnitude of P300 has a wider range when the subjects are stimulated by motion-in-depth asynchronous stereoscopic video clips. This indicates that the brain becomes more active in this circumstance. At the same time, the latency of P300 is longer than when stimulated by the motion-in-lateral asynchronous stereoscopic video clips, which means that when the subjects are stimulated by the same degree of asynchronicity of motion-in-depth and -in-lateral stereoscopic video clips, more time is required to process the stimulation of motion-in-depth stereoscopic video clips.
- stereoscopic video /
- asynchronous frame /
- event-related potentials /
- motion in depth /
- motion in lateral /
- difference

HTML全文

參考文獻(22)

[1]	Oh H, Kim J, Kim J, et al. Enhancement of visual comfort and sense of presence on stereoscopic 3D images. IEEE Trans Image Process, 2017, 26(8):3789
[2]	Parker A J. Binocular depth perception and the cerebral cortex. Nat Rev Neurosci, 2007, 8(5):379
[3]	Lin S L, Sawa Y, Fukushima N, et al. Influences of frame delay and packet loss between left and right frames in stereoscopic video communications//28th Picture Coding Symposium. Nagoya, 2010:510
[4]	Gao J K, Zhou J, Gu X. 3D frame synchronization detection based on classified epipolar geometry parameters//2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting. Beijing, 2014:1
[5]	Goldmann L, Lee J S, Ebrahimi T. Temporal synchronization in stereoscopic video:influence on quality of experience and automatic asynchrony detection//17th IEEE International Conference on Image Processing. Hong Kong, 2010:3241
[6]	Tam W J, Speranza F, Yano S, et al. Stereoscopic 3D-TV:visual comfort. IEEE Trans Broadcast, 2011, 57(2):335
[7]	Kim D, Choi S, Sohn K. Depth adjustment for stereoscopic images and subjective preference evaluation. J Electron Imaging, 2011, 20(3):033011
[8]	Hoffman D M, Girshick A R, Akeley K, et al. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vision, 2008, 8(3):33
[9]	Kuze J, Ukai K. Subjective evaluation of visual fatigue caused by motion images. Displays, 2008, 29(2):159
[10]	Scholler S, Bosse S, Treder M S, et al. Toward a direct measure of video quality perception using EEG. IEEE Trans Image Process, 2012, 21(5):2619
[11]	Li H C O, Seo J, Kham K, et al. Measurement of 3D visual fatigue using event-related potential (ERP):3D oddball paradigm//3D-TV Conference:the True Vision-Capture, Transmission and Display of 3D Video. Istanbul, 2008:213
[12]	Kaseda Y, Jiang C H, Kurokawa K, et al. Objective evaluation of fatigue by event-related potentials. J Neurolog Sci, 1998, 158(1):96
[13]	Luck S J. An Introduction to the Event-Related Potential Technique. The MIT Press, 2014
[14]	Jackson A F, Bolger D J. The neurophysiological bases of EEG and EEG measurement:a review for the rest of us. Psychophysiology, 2014, 51(11):1061
[16]	Mun S, Park M C, Park S, et al. SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D. Neurosci Lett, 2012, 525(2):89
[17]	Chey J, Grossberg S, Mingolla E. Neural dynamics of motion processing and speed discrimination. Vision Res, 1998, 38(18):2769
[18]	Chao L L, Knight R T. Prefrontal and posterior cortical activation during auditory working memory. Cogn Brain Res, 1995, 4(1):27
[19]	Chao L L, Knight R T. Contribution of human prefrontal cortex to delay performance. J Cogn Neurosci, 1998, 10(2):167
[20]	Breton F, Ritter W, Simson R, et al. The N2 component elicited by stimulus matches and multiple targets. Biol Psychol, 1988, 27(1):23
[21]	Folstein J R, Van Petten C. Influence of cognitive control and mismatch on the N2 component of the ERP:a review. Psychophysiology, 2008, 45(1):152
[22]	Hagen G F, Gatherwright J R, Lopez B A, et al. P3a from visual stimuli:task difficulty effects. Psychophysiology, 2006, 59(1):8
[23]	Kim K H, Kim J H, Yoon J, et al. Influence of task difficulty on the features of event-related potential during visual oddball task. Neurosci Lett, 2008, 445(2):179