<th id="5nh9l"></th><strike id="5nh9l"></strike><th id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"></th><strike id="5nh9l"></strike>
<progress id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"><noframes id="5nh9l">
<th id="5nh9l"></th> <strike id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"></span>
<progress id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"></span><strike id="5nh9l"><noframes id="5nh9l"><strike id="5nh9l"></strike>
<span id="5nh9l"><noframes id="5nh9l">
<span id="5nh9l"><noframes id="5nh9l">
<span id="5nh9l"></span><span id="5nh9l"><video id="5nh9l"></video></span>
<th id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"></th>
<progress id="5nh9l"><noframes id="5nh9l">
  • 《工程索引》(EI)刊源期刊
  • 中文核心期刊
  • 中國科技論文統計源期刊
  • 中國科學引文數據庫來源期刊

留言板

尊敬的讀者、作者、審稿人, 關于本刊的投稿、審稿、編輯和出版的任何問題, 您可以本頁添加留言。我們將盡快給您答復。謝謝您的支持!

姓名
郵箱
手機號碼
標題
留言內容
驗證碼

腦機接口在元宇宙中的應用研究進展

王雪 李莎 李榮洋 寧煥生

王雪, 李莎, 李榮洋, 寧煥生. 腦機接口在元宇宙中的應用研究進展[J]. 工程科學學報, 2023, 45(9): 1528-1538. doi: 10.13374/j.issn2095-9389.2023.02.15.001
引用本文: 王雪, 李莎, 李榮洋, 寧煥生. 腦機接口在元宇宙中的應用研究進展[J]. 工程科學學報, 2023, 45(9): 1528-1538. doi: 10.13374/j.issn2095-9389.2023.02.15.001
WANG Xue, LI Sha, LI Rongyang, NING Huansheng. Advances in the application of a brain–computer interface to the Metaverse[J]. Chinese Journal of Engineering, 2023, 45(9): 1528-1538. doi: 10.13374/j.issn2095-9389.2023.02.15.001
Citation: WANG Xue, LI Sha, LI Rongyang, NING Huansheng. Advances in the application of a brain–computer interface to the Metaverse[J]. Chinese Journal of Engineering, 2023, 45(9): 1528-1538. doi: 10.13374/j.issn2095-9389.2023.02.15.001

腦機接口在元宇宙中的應用研究進展

doi: 10.13374/j.issn2095-9389.2023.02.15.001
基金項目: 北京科技大學教改項目 (JG2020Z08)
詳細信息
    通訊作者:

    E-mail: shalee@ustb.edu.cn

  • 中圖分類號: TP399

Advances in the application of a brain–computer interface to the Metaverse

More Information
  • 摘要: 近期,隨著元宇宙研究重心轉向內容交流和社會互動,如何打破當前視聽媒體交互瓶頸成為了亟待解決的問題,使用腦機接口進行感官模擬就是解決方案之一. 目前,腦機接口已經作為生理信號采集工具在元宇宙諸多領域表現出了不可替代的應用潛力. 研究三個應用場景,元宇宙藝術中的生成藝術、元宇宙醫學中醫療保健嚴肅游戲、元宇宙虛擬社會中的虛擬人表情合成中腦機接口應用現狀,調查已經存在的商業產品和專利(MindWave Mobile、GVS、Galea ),類比網絡安全和神經安全、生物倫理學和神經倫理學的發展過程,探討腦機接口成熟并被廣泛應用后可能面臨的挑戰和潛在問題,展望未來腦機接口在元宇宙中深入多樣應用的可能性.

     

  • 圖  1  腦電數據驅動的生成藝術范例

    Figure  1.  EEG data-driven generative art application

    圖  2  基于VR與EEG的ASDs訓練/診斷系統

    Figure  2.  ASDs training/diagnosis system based on VR and EEG

    圖  3  腦電情感識別流程圖

    Figure  3.  EEG emotion-recognition flowchart

    圖  4  10–10腦電極導聯系統

    Figure  4.  10–10 electrode placement system

    圖  5  雙向腦機接口功能周期. (a) 正循環; (b)逆循環

    Figure  5.  Bidirectional brain–computer interface functional cycle: (a) positive cycle; (b) counter cycle

    表  1  5個流行社交虛擬平臺

    Table  1.   Five popular social virtual platforms

    PlatformCompanyStatusInitial releaseGenre
    AltspaceVRMicrosoftShut downMay 2015Virtual social community
    Horizon WorldsMetaOperatingDecember 2021Game creation system, massively multiplayer online
    Mozilla HubsMozillaOperatingApril 2014Virtual collaboration platform
    Rec RoomRec RoomOperatingJune 2016Game creation system, massively multiplayer online
    VRChatVRChatOperatingJanuary 2014Massively multiplayer online
    下載: 導出CSV

    表  2  神經技術商業化產品

    Table  2.   Neurotechnology commercialization products

    ProductCompanyPrice/$Outputs (bit)Sampling rate/HzChannelApplication
    MindWave Mobile 2NeuroSky109.99125121Games, education, wellness, research, develop
    Ganglion BoardOpenBCI499.00242004Research, develop
    Cyton Biosensing BoardOpenBCI999.00242508Research, develop
    Cyton+Daisy Biosensing BoardsOpenBCI1999.0024125/25016Research, develop
    Insight2Emotiv499.00161285Research, develop
    EPOC XEmotiv849.0014/16128/25614Research, develop
    EPOC FlexEmotiv1699.00 /2099.0014/1612832Research, develop
    下載: 導出CSV
    <th id="5nh9l"></th><strike id="5nh9l"></strike><th id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"></th><strike id="5nh9l"></strike>
    <progress id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"><noframes id="5nh9l">
    <th id="5nh9l"></th> <strike id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"></span>
    <progress id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"><noframes id="5nh9l"><span id="5nh9l"></span><strike id="5nh9l"><noframes id="5nh9l"><strike id="5nh9l"></strike>
    <span id="5nh9l"><noframes id="5nh9l">
    <span id="5nh9l"><noframes id="5nh9l">
    <span id="5nh9l"></span><span id="5nh9l"><video id="5nh9l"></video></span>
    <th id="5nh9l"><noframes id="5nh9l"><th id="5nh9l"></th>
    <progress id="5nh9l"><noframes id="5nh9l">
    259luxu-164
  • [1] Stephenson N. Snow Crash. New York: Bantam Dell, 2003.
    [2] Wang W X, Zhou F, Wan Y L, et al. A survey of metaverse technology. Chin J Eng, 2022, 44(4): 744 doi: 10.3321/j.issn.1001-053X.2022.4.bjkjdxxb202204025

    王文喜, 周芳, 萬月亮, 等. 元宇宙技術綜述. 工程科學學報, 2022, 44(4):744 doi: 10.3321/j.issn.1001-053X.2022.4.bjkjdxxb202204025
    [3] Wolpaw J R, Birbaumer N, McFarland D J, et al. Brain-computer interfaces for communication and control. Clin Neurophysiol, 2002, 113(6): 767 doi: 10.1016/S1388-2457(02)00057-3
    [4] Wolpaw J R, Wolpow E W. Brain-Computer Interfaces. Oxford: Oxford University Press, 2012
    [5] Aricò P, Sciaraffa N, Babiloni F. Brain-computer interfaces: Toward a daily life employment. Brain Sci, 2020, 10(3): 157 doi: 10.3390/brainsci10030157
    [6] Wang Z H, Yu Y, Xu M, et al. Towards a hybrid BCI gaming paradigm based on motor imagery and SSVEP. Int J Human–computer Interact, 2019, 35(3): 197 doi: 10.1080/10447318.2018.1445068
    [7] Cheng Q M. Structural forms of metaverse and the characteristics of metaverse art. J Zhejiang Shuren Univ, 2022, 22(4): 78 doi: 10.3969/j.issn.1671-2714.2022.04.010

    成喬明. 元宇宙的結構形態與藝術特征探析. 浙江樹人大學學報, 2022, 22(4):78 doi: 10.3969/j.issn.1671-2714.2022.04.010
    [8] Christiane Paul. A Companion to Digital Art. New Jersey: Wiley-Blackwell, 2016: 146.
    [9] Lin C T, Rajapakse R P C J, Tokuyama Y. Development of EEG data-driven generative art application for real-time and dynamic interaction. J Robotics Netw Artif Life, 2021, 8(2): 117 doi: 10.2991/jrnal.k.210713.010
    [10] Lee L H, Lin Z J, Hu R, et al. When creators meet the metaverse: A survey on computational arts [J/OL]. arXiv preprint (2021-11-26) [2023-2-15].https://arxiv.org/abs/2111.13486
    [11] Gao F. Meta-universe—a new ecology for the future development of computing art. Art Obs, 2022(4): 24 doi: 10.3969/j.issn.1006-8899.2022.04.009

    高峰. 元宇宙—未來計算藝術發展的新生態. 美術觀察, 2022(4):24 doi: 10.3969/j.issn.1006-8899.2022.04.009
    [12] Sun M T, Yang D W, Xie L S, et al. Research progress on the application of metaverse in chronic diseases health management. Fudan Univ J Med Sci, https://kns.cnki.net/kcms/detail/31.1885.R.20230312.2036.006.html

    孫夢婷, 楊達偉, 謝林杉, 等. 元宇宙醫學在慢性疾病健康管理中應用的研究進展. 復旦學報(醫學版), https://kns.cnki.net/kcms/detail/31.1885.R.20230312.2036.006.html
    [13] Susi T, Johannesson M, Backlund P. Serious Games: An Overview. Skovde: Institutionen for Kommunikation Och Information, 2007: 28
    [14] Hepburn S. Early Intensive Behavioral Intervention (EIBI). Encyclopedia of Autism Spectrum Disorders. 2nd Ed. London: Springer International Publishing, 2021
    [15] Mesa-Gresa P, Gil-Gómez H, Lozano-Quilis J A, et al. Effectiveness of virtual reality for children and adolescents with autism spectrum disorder: An evidence-based systematic review. Sensors, 2018, 18(8): 2486 doi: 10.3390/s18082486
    [16] Bozgeyikli L, Raij A, Katkoori S, et al. A survey on virtual reality for individuals with autism spectrum disorder: Design considerations. IEEE Trans Learn Technol, 2018, 11(2): 133 doi: 10.1109/TLT.2017.2739747
    [17] Chen J, Du Y S. Advances on the application of immersive virtual reality technology in the treatment of autism spectrum disorders. Chin J Child Health, 2020, 28(5): 543 doi: 10.11852/zgetbjzz2019-0615

    陳靜, 杜亞松. 沉浸式虛擬現實技術在孤獨癥譜系障礙治療中的應用進展. 中國兒童保健雜志, 2020, 28(5):543 doi: 10.11852/zgetbjzz2019-0615
    [18] Cevette M J, Stepanek J, Cocco D, et al. Oculo-vestibular recoupling using galvanic vestibular stimulation to mitigate simulator sickness. Aviat Space Environ Med, 2012, 83(6): 549 doi: 10.3357/ASEM.3239.2012
    [19] Oberman L M, Hubbard E M, Mccleery J P, et al. EEG evidence for mirror neuron dysfunction in autism spectrum disorders. Cognitive Brain Research, 2005, 24(2): 190 doi: 10.1016/j.cogbrainres.2005.01.014
    [20] Livingston L A, Colvert E, Bolton P, et al. Good social skills despite poor theory of mind: Exploring compensation in autism spectrum disorder. J Child Psychol Psychiatry, 2019, 60(1): 102 doi: 10.1111/jcpp.12886
    [21] Robles M, Namdarian N, Otto J, et al. A virtual reality based system for the screening and classification of autism. IEEE Trans Vis Comput Graph, 2022, 28(5): 2168 doi: 10.1109/TVCG.2022.3150489
    [22] Cheng R Z, Wu N, Varvello M, et al. Are we ready for metaverse? A measurement study of social virtual reality platforms // Proceedings of the 22nd ACM Internet Measurement Conference. Nice, 2022: 504
    [23] Song T F, Zheng W M, Song P, et al. EEG emotion recognition using dynamical graph convolutional neural networks. IEEE Trans Affect Comput, 2020, 11(3): 532 doi: 10.1109/TAFFC.2018.2817622
    [24] Allison B, Luth T, Valbuena D, et al. BCI demographics: How many (and what kinds of) people can use an SSVEP BCI? IEEE Trans Neural Syst Rehabil Eng, 2010, 18(2): 107
    [25] Picard R W. Affective Computing. Cambridge: MIT press, 2000
    [26] Bernal S L, Celdrán A H, Pérez G M, et al. Security in brain-computer interfaces: State-of-the-art, opportunities, and future challenges. ACM Comput Surv, 2020, 54(1): 1
    [27] Denning T, Matsuoka Y, Kohno T. Neurosecurity: Security and privacy for neural devices. Neurosurg Focus, 2009, 27(1): E7 doi: 10.3171/2009.4.FOCUS0985
    [28] Hu R, Zhang L Q, Meng P, et al. The neural responses of visual complexity in the oddball paradigm: An ERP study. Brain Sci, 2022, 12(4): 447 doi: 10.3390/brainsci12040447
    [29] Fisher R S, Acharya J N, Baumer F M, et al. Visually sensitive seizures: An updated review by the Epilepsy Foundation. Epilepsia, 2022, 63(4): 739 doi: 10.1111/epi.17175
    [30] Chiong W. Insiders and outsiders: Lessons for neuroethics from the history of bioethics. AJOB Neurosci, 2020, 11(3): 155 doi: 10.1080/21507740.2020.1778118
    [31] Carvalho C, Gaspar A, Knight A, et al. Ethical and scientific pitfalls concerning laboratory research with non-human primates, and possible solutions. Animals, 2018, 9(1): 12 doi: 10.3390/ani9010012
    [32] Ning H S, Tian Q H, Li S. Metaverse social governance. J Chongqing Univ Posts and Telecommun Soc Sci Ed, https://kns.cnki.net/kcms/detail/50.1180.C.20221123.1513.004.html

    寧煥生, 田巧惠, 李莎. 元宇宙社會治理. 重慶郵電大學學報(社會科學版), https://kns.cnki.net/kcms/detail/50.1180.C.20221123.1513.004.html
    [33] Naughton J. Are big tech’s efforts to show it cares about data ethics another diversion? The Guardian, 2019, 7: 1
    [34] Al-Saegh A, Dawwd S A, Abdul-Jabbar J M. Deep learning for motor imagery EEG-based classification: A review. Biomed Signal Process Control, 2021, 63: 102172 doi: 10.1016/j.bspc.2020.102172
    [35] Shi F F, Zhou F, Liu H, et al. Survey and tutorial on hybrid human-artificial intelligence. Tsinghua Sci Technol, 2022, 28(3): 486
    [36] Panagiotakopoulos D, Marentakis G, Metzitakos R, et al. Digital scent technology: Toward the Internet of senses and the metaverse. Prof, 2022, 24(3): 52
    [37] Ganzer P D, Colachis S C, Schwemmer M A, et al. Restoring the sense of touch using a sensorimotor demultiplexing neural interface. Cell, 2020, 181(4): 763 doi: 10.1016/j.cell.2020.03.054
    [38] Brooks J, Teng S Y, Wen J, et al. Stereo-smell via electrical trigeminal stimulation // Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Yokohama, 2021: 1
  • 加載中
圖(5) / 表(2)
計量
  • 文章訪問數:  508
  • HTML全文瀏覽量:  248
  • PDF下載量:  121
  • 被引次數: 0
出版歷程
  • 收稿日期:  2023-02-15
  • 網絡出版日期:  2023-03-28
  • 刊出日期:  2023-09-25

目錄

    /

    返回文章
    返回