压缩域视频拼接方法研究

本文主要研究实时视频应用的拼接方法并详述了其在云视频会议上的应用.不同于传统的基于转码的视频拼接,提出了基于压缩域码流的处理算法,并在云端架构视频处理器.以HEVC码流为例将码流处理的难点分为序列参数集、图片参数集、Slice头部和编码单元四个方面,对这些方面存在的问题给出了解决方法,从而实现了低复杂度的视频拼接算法.仿真结果表明,本文提出的压缩域视频拼接算法,在视频处理效率和质量上均有很大的提高.     

基于自适应量化矩阵的硬判决量化算法

在视频编码中,视频量化一般分为硬判决量化(HDQ)和软判决量化(SDQ),HDQ与SDQ相比,编码性能虽有所损失,但其编码复杂度低,易于硬件实现的优点依旧是主流编码器所主要采用的量化算法.人眼具有对图像中的高频细节不敏感的特性.因此,基于Bayes最小误判概率约束,离线构建基于视频内容自适应的量化矩阵,在模拟感知SDQ算法机理下,对高频低频分量采用不同的量化步长,提高视频的主观质量和HDQ算法性能.仿真实验表明,相比于传统的HDQ算法,该文算法能达到平均5.048％的码率节省,其中WVGA和WQVGA格式平均达到10.65％的码率节省.相比于感知SDQ算法,平均码率增加仅有1.464％;算法复杂度方面,编码一帧的时间相比于感知SDQ节省了32.956％.     

新媒体平台电视节目高效组织和浏览研究

为实现电视节目的快速传播和高效利用,提出了电视节目的新媒体平台高效组织和浏览技术.首先,通过传统广电媒资数据向新媒体平台的快速迁移实现电视节目的快速发布.然后,采集并分析用户的观看行为,通过基于投票的方法计算出视频热点区域,并添加中插故事点.最后,结合观看行为、用户和节目间相似性等信息,通过改进的协同过滤方法实现电视节目的个性化推荐.系统在多个省、市、县电视台的新媒体部门进行了试运行,结果表明系统操作简单、运行高效、能够显著提升电视节目的观赏体验,具有广泛的应用前景.     

基于软件流水线的并行多源视频处理

针对多源、复杂视频处理存在的实时性低,资源占用率高的问题,提出了一种基于软件流水线并行处理多源视频的方法,具有降低视频处理应用的设计难度,优化计算资源使用,提高复杂算法多源视频处理的实时性的特点.首先基于多核CPU构建多任务管理系统,用于任务缓存及调度,并管理资源负载,在此基础上设计软件流水线.软件流水线的每一个stage将对于一帧视频图像的处理封装成任务的形式提交给多任务管理系统调度执行.最后,将软件流水线用于多源视频处理,并行处理6路视频,试验结果表明该方法能够有效提升多源、复杂视频处理的实时性,且在资源利用率,负载均衡等方面具有良好特性.     

Android系统中RTMP流媒体直播的设计与实现

在人烟稀少、边远山区和高原等地区,无线基站覆盖面较小导致无线传输通道环境恶劣,无法有效实现远程高清音视频的实时播放.前端无线手持设备多采用Android操作系统,因此Android系统高质量实时传输高清音视频成为远程视频监控的关键问题.为保证高清音视频的稳定传输,解决网络拥塞和画面延迟抖动等问题,在Android系统上采用RTMP协议传输高清音视频,优化RTMP的数据传输策略,实现了高清音视频的无线传输.在严重丢失帧的恶劣环境下测试该系统,系统运行稳定,显著提高了音视频播放的流畅性和传输的服务质量.     

Adaptive packet scheduling for scalable video streaming with network coding

Over the last decade, the emergence of new multimedia devices has motivated the research on efficient media streaming mechanisms that adapt to dynamic network conditions and heterogeneous devices’ capabilities. Network coding as a rateless code has been applied to collaborative media streaming applications and brings substantial improvements regarding throughput and delay. However, little attention has been given to the recoverability of encoded data, especially for the streaming with a strict deadline. This in turn leads to severe quality of experience. In this paper, we solve the unrecoverable transmission by proposing a multi-generation packet scheduling problem, which is treated as a video quality maximization problem and solved using dynamic programming algorithm. Experimental results confirm that the proposed algorithm brings better data recoverability and better quality of service in terms of video quality, delivery ratio, lower redundancy rate under different network sizes.     

网络视频监控系统信息安全机制解析

信息安全机制是网络视频监控系统安全体系中的核心部分,其安全性包括业务数据安全性和音视频媒体数据安全性,对此,业界有多种解决方案和算法标准,选择了监控业界两个代表性网络视频监控标准的信息安全机制进行解读,分析了主流解决方案和算法,最后提出了通用的视频监控的信息安全机制建议.     

Circular intra prediction for 360 degree video coding

Different from traditional 2D video, the contents of 360 degree video are deformed due to the projection from 3D sphere to 2D plane. As a result, the traditional Angular Intra Prediction (AIP) with a linear pattern may not be always efficient. To further improve the coding performance of 360 degree video, a novel intra prediction method is presented in this paper, i.e., Circular Intra Prediction (CIP), which takes consideration of the spherical characteristics of 360 degree video. In specific, the proposed CIP is performed in a circular pattern, where the center of circle is located around the to-be-predicted block, and different centers of circle are able to produce different CIP modes. The distance between center of this circle and center of the to-be-predicted block is adaptively determined according to the degree of projection deformation, where stronger projection deformation needs shorter distance, and vice versa. As the increase of the distance, the CIP is more and more close to the traditional AIP. In addition, one additional binary flag is utilized to achieve better coding performance from the competition between AIP and CIP with the rate-distortion optimization. The proposed algorithm is implemented on the platform of Versatile video coding Test Model (VTM) 5.0 + 360Lib 9.1. Extensive experiments show that the proposed method can achieve bit rate reduction on this platform for 360 degree video coding.     

A practical design of digital watermarking for video streaming services

A practical design of digital watermarking for video streaming services is proposed in this research. The information of a legitimate recipient is represented as a watermark, which is embedded in the video stream to serve as a cue to trace the recipient in case a clone of the video is illegally distributed. The watermark signals are designed to embed in some areas of video frames to benefit the video stream server, as the result of only partial actions required, including decoding, processing and re-encoding. The invariance of feature points and the self-similarity of hidden signals are further exploited to enable watermark detection without involving the original video. The watermark can decently survive transcoding processes and geometrical modifications of frames. The experimental results demonstrate the advantages of the proposed scheme in terms of watermark visibility, capacity and detection methodology.     

Rough mode cost–based fast intra coding for high-efficiency video coding

The quadtree-based coding unit (CU) and transform unit (TU) structure, as well as various prediction units (PUs) of HEVC, considerably increase encoding complexity in intra coding and inter coding. This paper proposes a rough mode cost (RMC)-based algorithm for accelerating CU/TU depth decisions and PU mode decisions in HEVC intra coding. For CU depth decisions, RMC values are used for the fast determination of CU partition. In the case of PU mode decisions, modes with higher RMCs are removed from the candidate list to reduce the number of test modes. For TU depth decisions, the TU partition of the mode with the least RMC is used to determine the TU partitions of remaining modes. The proposed TU partitioning method demonstrates superior performance to the default method in reference software. The proposed algorithm can reduce encoding time by approximately 51% on average, with a 0.69% increase in the Bjøntegaard-Delta (BD) rate.