应用科学学报 ›› 2011, Vol. 29 ›› Issue (3): 299-307.doi: 10.3969/j.issn.0255-8297.2011.03.014

• 信号与信息处理 • 上一篇    下一篇

FTV系统中面向虚拟视点合成的深度编码

张秋闻1, 安平1;2, 张艳1;3, 张兆扬1;2   

  1. 1. 上海大学通信与信息工程学院,上海200072
    2. 新型显示技术及应用集成教育部重点实验室,上海200072
    3. 安徽财经大学计算机科学与技术系,安徽蚌埠230030
  • 收稿日期:2010-09-21 修回日期:2011-04-06 出版日期:2011-05-26 发布日期:2011-05-26
  • 作者简介:张秋闻,博士生,研究方向:多视点视频深度编码,E-mail: zhangqwen@yahoo.com.cn;安平,教授,博导,研究方向:视频处理及三维视觉,E-mail: anping@shu.edu.cn;张兆杨,教授,博导,研究方向:视频处理和多媒体通信,E-mail: zhyzhang@shu.edu.cn
  • 基金资助:

    国家自然科学基金(No.60832003); 上海市科委世博专项基金(No.10dz0580800);上海市科委重点项目基金(No.10510500500);
    安徽高校省级自然科学研究项目基金(No.KJ2011Z008)资助

Depth Map Coding Oriented to Virtual View Synthesis in FTV System

ZHANG Qiu-wen1, AN Ping1;2, ZHANG Yan1;3, ZHANG Zhao-yang1;2   

  1. 1. School of Communication and Information Engineering, Shanghai University, Shanghai 200072, China
    2. Key Laboratory of Advanced Displays and System Application, Ministry of Education,
    Shanghai 200072, China
    3. Department of Computer Science and Technology, Anhui University of Finance and Economics,
    Bengbu 230030, Anhui Province, China
  • Received:2010-09-21 Revised:2011-04-06 Online:2011-05-26 Published:2011-05-26

摘要:

为了降低自由视点电视系统中由于深度估计不准确和深度数据压缩带来的量化失真对重建虚拟视点图像质量产生的影响,提出了一种面向虚拟视点绘制的深度压缩算法. 根据深度数据的统计特性,设计了一种基于三次B样条函数的上下采样方法对深度图进行下采样. 采用多视点视频编码对下采样深度图进行编码,在解码端则对深度图进行上采样,并针对解码深度图边缘处的模糊现象,用双边滤波器优化深度图边界. 实验结果表明,与传统的MVC编码方案相比,该方案在保持虚拟绘制图像质量不变(甚至略有提升)的情况下,显著降低了传输码率,有助于在自由视点系统的接收端获得高精度的重建图像.

关键词: 自由视点电视, 视点合成, 深度编码, 多视点视频编码

Abstract:

A depth map compression method oriented to virtual view rendering is proposed to reduce distortion of virtual view synthesis in a free-viewpoint television (FTV) system. The distortion is caused by quantization of depth data and inaccuracy of depth estimation algorithm. According to the statistics of depth data, a depth down/up sampling techniques based on the non-uniform B-spline curve is proposed. The depth map is down-sampled and coded with MVC. In the de-coding side, the depth map is up-sampled. To deal with the serration phenomenon in edges of the decoded depth image, a bilateral filtering is used to align the object boundaries. The experimental results evaluated by objective and subjective methods indicate that the proposed method can reduce bit-rate of depth coding and achieve better rendering quality. It can improve high-accurate reconstruction of synthesized images at the receiver of FTV systems.

Key words:  free-viewpoint television (FTV), view synthesis, depth coding, multi-view video coding (MVC)

中图分类号: