3D电视传输技术发展路线

引言 按照国际电联（ITU）对3D电视系统的代次划分。3D电视系统共分为3代．从佩戴眼镜观看一个视角的3D视频,发展到允许头部移动观看多个视角的3D视频．并最终演进为自然3D视频。第一代3D电视系统传输两路视频信号．分别用于左右眼的观看．因此传输的视觉信息中只包含有一种视差效果,观看者通常需要佩戴眼镜。     

裸眼3D电视编码技术

本文基于最新的视频编码标准HEVC的3D编码技术扩展,介绍了纹理与深度的3D视频编码技术。     

帧差预测3D-DCT子带分层编码的研究

本文提出了一种利用３Ｄ－ＤＣＴ帧差预测变换域频率系数进行了带划分的分层编码方法。与其它变换系数分层编码相比,３Ｄ－ＤＣＴ变换编码概念的引入,使该方法可以在实现空间方向分层的同时,实现时间方向分层。另外,它比采用时间方向亚抽样和空间滤波器的分辨率分层方法更灵活,并克服了频率混叠现象。该方法可用于实现分层图像通信,适合未通信发展的需要。     

一种HEVC帧内快速编码算法

高效视频编码(HEVC)采用编码单元(CU)四叉树的 分割结构,相比H.264/AVC显著地提升了编码效 率,但却使编码复杂度急剧增加。为此,本文提出一种帧内快速编码算法。首先,根据视 频图像纹理复 杂度,提前判断是否进行最大编码单元(LCU)分割。然后,根据空域相邻CU的深度预测当前C U的深度范围, 跳过不必要的计算;最后,根据预测模式被选为最优预测模式的统计特性,去掉可能性小的 帧内预测模式。本文算法在HM14.0的基础上实现。 仿真结果表明,本文算法在全I帧模式下与HM14.0相比,帧内编码时 间平均减少38%,码率(BR)只增加1.41%,峰值信噪比(PSNR)只降低0.29dB,在保证编码性能和视频质量几乎不变的 情况下,本文算法降低了编码的计算复杂度。     

结合预处理的深度视频帧内快速编码算法

多视点彩色加深度(MVD)视频是三维(3D)视频的 主流格式。在3D高效视频编码中,深度视频帧内编码 具有较高的编码复杂度;深度估计软件获取的深度视频由于不够准确会使深度图平坦 区域纹理增加, 从而进一步增加帧内编码复杂度。针对以上问题,本文提出了一种联合深度处理的深度视频 帧内低复杂度 编码算法。首先,在编码前对深度视频进行预处理,减少由于深度图不准确而出现的纹理信 息;其次,运 用反向传播神经网络(BPNN,backpropagation neural network)预测最大编码单元 (LCU,la rgest coding unit)的最大划分深度;最后联合深度视频的边缘信 息及对应的彩色LCU最大划分深度进行CU提前终止划分和快速模式选取。实验结果表明, 本文算法在保证 虚拟视点质量的前提下,BDBR下降0.33% ,深度视频编码时间平均节省50.63%。     

CCTV 2013年进行AVS＋标准高清帧兼容3D电视试验

2012年8月24日,国家广播电影电视总局科技司与工业和信息化部电子信息司在北京共同主办了“《广播电视先进音视频编解码第1部分：视频》（AVS＋）标准发布暨宣贯会”,共同推进该标准的应用和产业化。国家广播电影电视总局科技司与工业和信息化部电子信息司于2012年3月18日共同成立“AVS技术应用联合推进工作组”．     

基于HEVC的3D视频编码技术

3D视频编码技术概况 近年来．欧美等国陆续开播了3D电视频道．我国首个3D电视试验频道也于2012年开播,3D电视呈快速发展的态势。根据广电总局《“十二五”时期广播影视科技发展规划》,到2015年,全国具备提供10个立体电视频道的能力。     

基于深度学习的3D视频编码研究

针对当前网络系统对3D视频系统的需求,提出了一种基于深度学习的3D视频编码系统。首先,针对当前网络系统终端多样化问题,深入研究基于深度学习的鲁棒性 3D 视频编码;其次,针对当前网络系统中的设备不能处理高复杂度的问题,进一步研究基于深度学习的低复杂度3D视频编码;然后,针对当前网络系统中视频信息庞大问题,深入研究基于深度学习的高效3D视频编码;最后,针对人类是视频信息的最终接收体,深入研究基于深度学习的满足人类视觉特性的3D视频编码。实验结果表明,所提方法实现了基于深度学习的鲁棒、低复杂度、高效、符合人类视觉特性的3D视频编码。     

3D-HEVC深度图像帧内编码单元划分快速算法

针对3维高性能视频编码(3D-HEVC)中深度图像帧内编码单元(Coding Unit, CU)划分复杂度高的问题,该文提出一种基于角点和彩色图像的自适应快速CU划分算法。首先利用角点算子,并根据量化参数选取一定数目的角点,以此进行CU的预划分;然后联合彩色图像的CU划分对预划分的CU深度级进行调整;最后依据调整后的CU深度级,缩小当前CU的深度级范围。实验结果表明,与原始3D-HEVC的算法相比,该文所提算法平均减少了约63%的编码时间;与只基于彩色图像的算法相比,该文的算法减少了约13%的编码时间,同时降低了约3%的平均比特率,有效地提高了编码效率。     

Overview of the MVC + D 3D video coding standard

3D video services are emerging in various application domains including cinema, TV broadcasting, Blu-ray discs, streaming and smartphones. A majority of the 3D video content in market is still based on stereo video, which is typically coded with the multiview video coding (MVC) extension of the Advanced Video Coding (H.264/AVC) standard or as frame-compatible stereoscopic video. However, the 3D video technologies face challenges as well as opportunities to support more demanding application scenarios, such as immersive 3D telepresence with numerous views and 3D perception adaptation for heterogeneous 3D devices and/or user preferences. The Multiview Video plus Depth (MVD) format enables depth-image-based rendering (DIBR) of additional viewpoints in the decoding side and hence helps in such advanced application scenarios. This paper reviews the MVC + D standard, which specifies an MVC-compatible MVD coding format.     

面向3D呈现的有损和无损混合深度视频编码

针对多个深度视频流提出实时的压缩方法和评估 方案,采用一种有损无损混合的编码 方法,可以在图像质量和压缩率之间提供一种有效的平衡控制。行程编码(RLE)用于无损 压 缩,用来保存深度图像素的高位;像素低10bits保存在YUV图像的Y通道,直接使用×264编码。 实验表明,所提方法可以在平均时间小于12ms的前提下同时编解码 多个深度图。在实时传输 中,通过动态调节质量控制级别,可以获取4∶1到20∶ 1的压缩率。在压缩率10∶1的情况下,主观解码3D重构 效果与原始图几乎完全一致。     

新一代基于HEVC的3D视频编码技术

HEVC标准出台后,新一代基于HEVC的多视点加深度编码也将正式推出。基于HEVC的3D视频编码作为HEVC标准的扩展部分,主要面向立体电视和自由立体视频。从该编码方式的基本结构出发,较全面地介绍了视频编码方式、深度图编码方式和对深度图的编码控制三个方面的关键技术,包括视点间运动预测、深度图建模模式和视点合成优化等技术。     

7.1.4三维声录音棚系统设计

本文介绍了我台基于AVID Protools音频工作站、MTRIX音频矩阵为核心的7.1.4三维声录音制作系统。以此为核心机房,将我台分布于不同楼层的录音棚资源进行整合的先进声音制作系统。     

HEVC-based 3D holoscopic video coding using self-similarity compensated prediction

Holoscopic imaging, also known as integral, light field, and plenoptic imaging, is an appealing technology for glassless 3D video systems, which has recently emerged as a prospective candidate for future image and video applications, such as 3D television. However, to successfully introduce 3D holoscopic video applications into the market, adequate coding tools that can efficiently handle 3D holoscopic video are necessary. In this context, this paper discusses the requirements and challenges for 3D holoscopic video coding, and presents an efficient 3D holoscopic coding scheme based on High Efficiency Video Coding (HEVC). The proposed 3D holoscopic codec makes use of the self-similarity (SS) compensated prediction concept to efficiently explore the inherent correlation of the 3D holoscopic content in Intra- and Inter-coded frames, as well as a novel vector prediction scheme to take advantage of the peculiar characteristics of the SS prediction data. Extensive experiments were conducted, and have shown that the proposed solution is able to outperform HEVC as well as other coding solutions proposed in the literature. Moreover, a consistently better performance is also observed for a set of different quality metrics proposed in the literature for 3D holoscopic content, as well as for the visual quality of views synthesized from decompressed 3D holoscopic content.     

面向多声道三维音频的和差压缩编码技术

分析了传统基于单声道对的和差(M/S)编码技术,针对三维音频系统的空间特性将其拓展为基于三声道的和差编码技术(3D-M/S)。并提出一种基于3D-M/S的音频编码框架,使其能够压缩任意声道配置的三维音频系统。实验结果表明与独立声道编码相比,所提方法能够在相同码率下提高约25%的客观质量。并且在同等质量下,所提方法引起编解码复杂度的增加约为基于PCA编解码方法的1/3。     

A 3D-DCT video encoder using advanced coding techniques for low power mobile device

The three-dimensional discrete cosine transform (3D-DCT) has been researched as an alternative to existing dominant video standards based on motion estimation and compensation. Since it does not need to search macro block for inter/intra prediction, 3D-DCT has great advantages for complexity. However, it has not been developed well because of poor video quality while video standards such as H.263(+) and HEVC have been blooming. In this paper, we propose a new 3D-DCT video coding as a new video solution for low power mobile technologies such as Internet of Things (IoT) and Drone. We focus on overcoming drawbacks reported in previous research. We build a complete 3D-DCT video coding system by adopting existing advanced techniques and devising new coding algorithms to improve overall performance of 3D-DCT. Experimental results show proposed 3D-DCT outperforms H.264 low power profiles while offering less complexity. From GBD-PSNR, proposed 3D-DCT provides better performance by average 4.6 dB.     

Synchronous 2D/3D Switching System for Service‐Compatible 3DTV Broadcasting

This paper proposes a new broadcasting system for the service‐compatible 3DTV in which the 3D service can coexist with the conventional digital TV broadcast. In the proposed system, the commercial 3DTV service can be implemented via the existing DTV channel without utilizing the dedicated 3DTV system. This 2D/3D system interworks with the conventional system and can switch to 2D or 3D service according to the broadcast programming and schedule. The system also provides a mechanism that can prevent the synchronization mismatch between left and right video streams and between the stream and the associated signaling in the 2D/3D transition periods. The picture quality measurements are carried out based on the ITU‐R recommended test to check the level of quality of service provided by the proposed scheme. The conformity tests are also performed with the conventional channel and the receiver for the DTV system to confirm the feasibility of the proposed one for the commercial service.     

Impact of 2D and 3D display watching on EEG power spectra: A standardized low-resolution tomography (sLORETA) study

We investigated whether watching two-dimensional television (2DTV) or three-dimensional television (3DTV) resulted in differences in the brain’s processing of sensory information. We divided 25 participants into 2DTV (n = 13) and 3DTV (n = 12) groups. Participants watched 2DTV or 3DTV for 1, 2, or 3 h on different days. Before and at the end of each session, electroencephalography (EEG) was recorded for 10 min. The Simulation Sickness Questionnaire (SSQ) and the Visual Analog Scale (VAS) were used to assess general discomfort before and after watching. Each frequency band of the resting EEG was transformed into a standardized low-resolution electromagnetic tomographic (sLORETA) image. In the 2DTV group, 2 h of watching increased theta power in the central cortex and 3 h of watching increased beta power in the occipital cortex. In the 3DTV group, 3 h of watching increased delta power in the parahippocampal gyrus and middle frontal cortex. Theta power was significantly higher in the insular cortex after 3 h of 3DTV than after 3 h of 2DTV. SSQ scores were significantly higher after 1 h of 2DTV than after 1 h of 3DTV. Watching 2DTV vs. 3DTV triggered different time-dependent activity patterns. Watching 3DTV for 3 h increased slow-wave activity in the prefrontal cortex, while watching 2DTV increased fast-wave activity in the occipitoparietal cortex. Up to 2 h of 3DTV watching did not cause major changes in fatigue or EEG activity compared with 2DTV. Our findings promise to be useful in designing safety guidelines for watching 3DTV.