Depth video spatial and temporal correlation enhancement algorithm based on just noticeable rendering distortion model |
| |
| Institution: | 1. Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China;2. School of Information and Mechatronics, Gwangju Institute of Science and Technology (GIST), Gwangju 500-712, Republic of Korea;1. Graduate Institute of Mathematics and Science Education, National Chiayi University, Chiayi 621, Taiwan, ROC;2. Department of Computer Science and Information Engineering, National Chiayi University, Chiayi 600, Taiwan, ROC;1. School of Information Science and Engineering, Ningbo Institute of Technology, Zhejiang University, Ningbo 315100, China;2. School of Information and Engineering, Huzhou Teachers College, Huzhou 313000, China;1. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China;2. School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China;1. School of Computer and Electronic Information, Guangxi University, Nanning, Guangxi 530004, China;2. Department of Computer Science and Engineering, Arizona State University, Tempe, AZ 85287, USA |
| |
| Abstract: | Spatial and temporal inconsistency of depth video deteriorates encoding efficiency in three dimensional video systems. A depth video processing algorithm based on human perception is presented. Firstly, a just noticeable rendering distortion (JNRD) model is formulated by combining the analyses of the influence of depth distortion on virtual view rendering with human visual perception characteristics. Then, depth video is processed based on the JNRD model from two aspects, spatial and temporal correlation enhancement. During the process of spatial correlation enhancement, depth video is segmented into edge, foreground, and background regions, and smoothened by Gaussian and mean filters. The operations of the temporal correlation enhancement include temporal–spatial transpose (TST), temporal smoothing filter and inverse TST. Finally, encoding and virtual view rendering experiments are conducted to evaluate the proposed algorithm. Experimental results show that the proposed algorithm can greatly reduce the bit rate while it maintains the quality of virtual view. |
| |
| Keywords: | Three dimensional video system Depth video Just noticeable rendering distortion Virtual view rendering Spatial and temporal enhancement Human visual perception Depth video segmentation Bit rate saving |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
