基于视频虚拟化身的远程视频协作

现有的远程视频通信系统往往局限于如何实时、准确地传递足量的信息,却忽略了远程通信双方的交互需求;此外,传统的视频通信基于二维信息,并未对双方的三维信息充分加以利用.因此,在视频通信中融入3D技术,可以使得远程交互更加自然、高效,增强通信沉浸感.本文着眼于远程视频协作中的交互层面,提出了远程视频协作系统的"沉浸式"设计目标,据此设计并实现了一种新型的、基于视频虚拟化身的远程视频协作系统.具体而言,系统使用Creative Senz3D深度摄像头,通过背景分割技术提取通信者的前景图像以作为虚拟化身,再将不同通信者的虚拟化身置于共同的虚拟场景之中,并在系统中加入手势的辅助控制,设计了人物之间、人物与虚拟场景之间的自然的、"沉浸式"的交互方式,拓展了远程通信的交互协作模式.最后通过用户实验表明,本文设计的基于视频虚拟化身的远程视频协作模式,可以有效地提升远程通信协作的沉浸感.

Video avatar-based remote video collaboration

Most existing remote video communication systems are confined to how to accurately deliver adequate information in real time, but lose sight of communicators' interaction demands. Meanwhile, traditional 2D-based video communications cannot make full use of people's 3D information, which shows great potential for video communication to achieve immersive, natural and efficient interactions with 3D technique. To enhance the immersion sense and expand interaction modes in video collaboration, the design goal for ‘immersive' video communication systems was proposed and a novel, avatar-based remote video collaboration system was designed and implemented. Specifically, using Creative Senz3D depth camera, the proposed system extracted people's foreground images through background segmentation as their video avatars, and located the avatars together in a common virtual scenario. Natural and immersive interactions among people and between people and virtual scenes were also well designed, which expanded modes of interaction and collaboration in video communication. Finally, a user study was conducted and the result indicates that the proposed video avatar-based remote video cooperation mode can effectively enhance people's sense of immersion in telecommunication.