JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2016, Vol. 51 ›› Issue (3): 122-131.doi: 10.6040/j.issn.1671-9352.0.2015.431

Previous Articles     Next Articles

A modifiedtwo-viewpoint DIBR based virtual view synthesis method

WANG Lu1, LAI Chun-lu2*   

  1. 1. Network and information management center, Shandong University(Weihai), Weihai 264209, Shandong, China;
    2. School of Information and Electrical Engineering, Harbin Institute of Technology at Weihai, Weihai 264209, Shandong, China
  • Received:2015-09-04 Online:2016-03-20 Published:2016-04-07

PDF (PC)

657

Abstract: The depth-image-based rendering(DIBR)is a classical virtual view synthesis technique which has been regarded as one of the most crucial techniques for the naked eye three-dimensional television. In order to fill the holes existed in the virtual images obtained by DIBR and thus to improve the quality of the images, a modified two-viewpoint DIBR based virtual view synthesis method is wasproposed. To prevent the image from severe geometry distortions while the number of holes being reduced, only those areas of the depth image with sudden changes on the depth value were preprocessed. In order to obtain virtual images without ghosting errors and large holes, the two virtual images generated from different viewpoints were dilated at first and then merged into one using a distance-and-depth based image blending algorithm proposed in this paper. To fill the residual holes after the image fusion, a shell-by-shell filling method was also presented.Experimental results show that the proposed method can obtain satisfactory performance in both subjective quality and objective evaluation.

Key words: virtual view, image blending, image rendering

CLC Number: 

  • TN911.73
[1] TANIMOTO M, TEHRANI M P, FUJII T, et al. Free-viewpoint TV[J]. IEEE Signal Processing Magazine, 2011, 28(1):67-76.
[2] FEHN C. Depth-image-based rendering(DIBR), compression and transmission for a new approach on 3D-TV[J]. SPIE Stereoscopic Displays and Virtual Reality Systems XI, 2004, 5291:93-104.
[3] AHN I, KIM C. A novel depth-based virtual view synthesis method for free viewpoint video[J]. IEEE Transactions on Broadcasting, 2013, 59(59):614-626.
[4] ZHU Shiping, LI Zheng, YU Yang. Virtual view synthesis using stereo vision based on the sum of absolute difference[J]. Computers and Electrical Engineering, 2014, 40(8):236-246.
[5] YANG Xiaohui, LIU Ju, SUN Jiande, et al. DIBR based view synthesis for free-viewpoint television[C] // Proceedings of 3DTV Conference: the True Vision-capture.Washington: IEEE, 2011, 47(10):1-4.
[6] KRISHNAMURTHY S, RAMAKRISHNAN K R. Virtual view synthesis by Non-local means filtering using temporal data[C] // Proceedings of 3dtv-Conference: the True Vision-capture. Washington: IEEE, 2014: 1-4
[7] KIM B, HONG M. An adaptive interpolation algorithm for hole-filling in free viewpoint video[J]. Journal of Measurement Science and Instrumentation, 2013, 4(4):343-345.
[8] KWAN-JUNG O, SEHOON Y, ANTHONY V, et al. Virtual view synthesis method and self-evaluation metrics for viewpoint television and 3D video[J]. International Journal of Imaging Systems and Technology, 2010, 20(4):378-390.
[9] DARIBO I, TILLIER C, PESQUET-POPESCU B. Distance dependent depth filtering in 3D warping for 3DTV[C] // Proceedings of IEEE 9th International Workshop on Multimedia Signal Processing(MMSP 2007). Washington: IEEE, 2007: 312-315.
[10] QIAO Yiguo, JUNG C. Dictionary based hole filling with assistance of depth[C] // Proceedings of IEEE International Conference on Multimedia and Expo(ICME 2014). Washington: IEEE, 2014.
[11] HABIGT J, DIEPOLD K. Image completion for view synthesis using Markovrandom fields and efficient belief propagation[C] // Proceedings of IEEE International Conference on Image Processing(ICIP 2013). Washington: IEEE, 2013: 2131-2134.
[12] ZHONG Lin, PARK M, METAXAS D. Automatic stereoscopic video generation based on virtual viewsynthesis[J]. Neurocomputing, 2015, 151(P2):654-662.
[13] ZITNICK C L, KANG S B, UYTTENDAELE M, et al. High-quality video view interpolation using a layered representation[J]. ACM SIGGRAPH and ACM Transcations on Graphics, 2004, 23(4):600-608.
[14] WANG Lu, LIU Ju, SUN Jiande, et al. Virtual view synthesis without preprocessing depth image for depth image based rendering[C] // Proceedings of 3DTV-Conference: the True Vision-Capture, Transmission and Display of 3D Video(3DTV-CON 2011).Washington: IEEE, 2011: 1-4.
[15] GREENE N, KASS M, MILLER G. Hierarchical Z-buffer visibility[C] // Proceedings of the ACM SIGGRAPH’93 Conference on Computer Graphics. New York: ACM, 1993: 231-238.
[16] GONZALEZ R C, WOODS R E. Digital image processing[M]. 2nd ed. USA: Prentice Hall, 2002.
[17] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4):600-612.
[18] PINSON M H, WOLF S. A new standardized method for objectively measuring video quality[J]. IEEE Transactions on Broadcasting, 2004, 50(3):312-322.
No related articles found!
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE)
Supported by Beijing Magtech Co.Ltd