11.14.3.11 Image Based Rendering, View Generation for Video, Free-Viewpoint Video

Chapter Contents (Back)
Graphics. Free-Viewpoint Video. Image Based Rendering. Video Synthesis.
See also View Interpolation for Image Based Rendering.
See also Stereoscopic Viewing, Three Dimensional Visualization, Displays.
See also Inpainting, Video Inpainting. Some of the more specific papers have moved:
See also Image Based Rendering for Retargeting.
See also View Generation for Video, Free-Viewpoint Video, Stereo and Depth Aided. For applications see also:
See also Human Activities, Sports, Planned Activities.
See also Outpainting, Extrapolation.

Make3D,
Online2009.
WWW Link. Code, 3D Fly Through. 3-D fly through from a single image. 0907
BibRef

Martin, H.L.[H. Lee], Grantham, H.C.[H. Craig],
Method and apparatus for providing perceived video viewing experiences using still images,
US_Patent5,764,276, Jun 9, 1998
WWW Link. What you can do without even intermediate rendering. BibRef 9806

Boyken, J.D.[Jeffery D.], Mitchell, B.K.[Brian K.], Wells, R.V.[Robert V.],
Method and apparatus for generating virtual views of sporting events,
US_Patent6,124,862, Sep 26, 2000
WWW Link. BibRef 0009

Wang, R.S., Wang, Y.,
Multiview Video Sequence Analysis, Compression, and Virtual Viewpoint Synthesis,
CirSysVideo(10), No. 3, April 2000, pp. 397-410.
IEEE Top Reference. 0004
BibRef

Chang, N.L., Zakhor, A.,
View Generation for 3-Dimensional Scenes from Video Sequences,
IP(6), No. 4, April 1997, pp. 584-598.
IEEE DOI 9704
BibRef

Chang, N.L.[Nelson L.], Zakhor, A.[Avideh],
Constructing a Multivalued Representation for View Synthesis,
IJCV(45), No. 2, November 2001, pp. 157-190.
DOI Link 0111
BibRef
Earlier:
A Multivalued Representation for View Synthesis,
ICIP99(II:505-509).
IEEE DOI BibRef

Deering, M.F.[Michael F.],
System and method for generating and playback of three-dimensional movies,
US_Patent6,429,867, Aug 6, 2002
WWW Link. BibRef 0208

Murata, H.[Haruhiko], Mori, Y.[Yukio], Yamashita, S.[Shuugo], Maenaka, A.[Akihiro], Okada, S.[Seiji], Ihara, K.[Kanji],
Device and method for converting two-dimensional video into three-dimensional video,
US_Patent6,445,833, Sep 3, 2002
WWW Link. BibRef 0209

Simpson, T.[Todd], Vanwieren, E.C.[Edward C.], Spooner, D.A.[David Alan], Bruton, L.T.[Leonard Thomas],
System and method for creating 3D models from 2D sequential image data,
US_Patent6,466,205, Oct 15, 2002
WWW Link. BibRef 0210

Magnor, M.A., Ramanathan, P., Girod, B.,
Multi-View Coding for Image-Based Rendering Using 3-D Scene Geometry,
CirSysVideo(13), No. 11, November 2003, pp. 1092-1106.
IEEE Abstract. 0311
BibRef

Yaguchi, S., Saito, H.,
Arbitrary Viewpoint Video Synthesis From Multiple Uncalibrated Cameras,
SMC-B(34), No. 1, February 2004, pp. 430-439.
IEEE Abstract. 0403
BibRef
Earlier:
Arbitrary Viewpoint Video Synthesis from Uncalibrated Multiple Cameras,
WSCG02(521).
HTML Version. 0209
BibRef

Nozick, V.[Vincent], Saito, H.[Hideo],
Online Multiple View Computation for Autostereoscopic Display,
PSIVT07(399-412).
Springer DOI 0712
BibRef
And:
Real-Time Free Viewpoint from Multiple Moving Cameras,
ACIVS07(72-83).
Springer DOI 0708
BibRef

Ito, Y., Saito, H.,
Free-Viewpoint Image Synthesis from Multiple-View Images Taken with Uncalibrated Moving Cameras,
ICIP05(III: 29-32).
IEEE DOI 0512
BibRef

Matsuyama, T., Wu, X.J.[Xiao-Jun], Takai, T., Wada, T.,
Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video,
CirSysVideo(14), No. 3, March 2004, pp. 357-369.
IEEE Abstract. 0407
BibRef

Matsuyama, T., Wu, X., Takai, T., Nobuhara, S.,
Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video,
CVIU(96), No. 3, December 2004, pp. 393-434.
Elsevier DOI 0411
BibRef
Earlier: A1, A3, Only:
Generation, visualization, and editing of 3D video,
3DPVT02(234-245).
IEEE DOI 0206
3-D Video to generate any other view. Multi-view images, deformable models, rendering algorithm. BibRef

Tung, T.[Tony], Nobuhara, S.[Shohei], Matsuyama, T.[Takashi],
Simultaneous super-resolution and 3D video using graph-cuts,
CVPR08(1-8).
IEEE DOI 0806
BibRef

Nobuhara, S.[Shohei], Matsuyama, T.[Takashi],
Deformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video,
3DPVT06(264-271).
IEEE DOI 0606
BibRef
Earlier:
Heterogeneous deformation model for 3D shape and motion recovery from multi-viewpoint images,
3DPVT04(566-573).
IEEE DOI 0412
BibRef

Bao, P., Gourlay, D.,
Remote walkthrough over mobile networks using 3-D image warping and streaming,
VISP(151), No. 4, August 2004, pp. 329-336.
IEEE Abstract. 0411
BibRef

Zhao, W.Y.[Wen-Yi], Nister, D., Hsu, S.,
Alignment of Continuous Video onto 3D Point Clouds,
PAMI(27), No. 8, August 2005, pp. 1305-1318.
IEEE Abstract. 0506
BibRef
Earlier: CVPR04(II: 964-971).
IEEE DOI 0408
BibRef

Lau, D.L., Yang, R.,
Real-time multispectral color video synthesis using an array of commodity cameras,
RealTimeImg(11), No. 2, April 2005, pp. 109-116.
Elsevier DOI 0506
BibRef

Komodakis, N.[Nikos], Panagiotakis, C.[Costas], Tziritas, G.[George],
3D visual reconstruction of large scale natural sites and their fauna,
SP:IC(20), No. 9-10, October-November 2005, pp. 869-890.
Elsevier DOI 0510
BibRef
Earlier:
Interactive walkthroughs using 'morphable 3D-mosaics',
3DPVT04(404-411).
IEEE DOI 0412
BibRef

Komodakis, N.[Nikos], Tziritas, G.[Georgios],
Real-time exploration and photorealistic reconstruction of large natural environments,
VC(25), No. 2, February 2009, pp. xx-yy.
Springer DOI 0902
BibRef

Panagiotakis, C.[Costas], Tziritas, G.[George],
Construction of animal models and motion synthesis in 3D virtual environments using image sequences,
3DPVT04(250-257).
IEEE DOI 0412
BibRef

Rodríguez, T.[Tomás], Sturm, P.F.[Peter F.], Gargallo, P.[Pau], Guilbert, N.[Nicolas], Heyden, A.[Anders], Jaureguizar, F.[Fernando], Menéndez, J.M., Ronda, J.I.,
Photorealistic 3D reconstruction from handheld cameras,
MVA(16), No. 4, September 2005, pp. 246-257.
Springer DOI 0512
BibRef

Rodriguez, T., Sturm, P.F., Wilczkowiak, M., Bartoli, A.E., Personnaz, M., Guilbert, N., Kahl, F., Johansson, M., Heyden, A., Menendez, J.M., Ronda, J.I., Jaureguizar, F.,
Visire: Photorealistic 3D Reconstruction from Video Sequences,
ICIP03(III: 705-708).
IEEE DOI 0312
BibRef

Guilbert, N.,
Batch Recovery of Multiple Views with Missing Data Using Direct Sparse Solvers,
BMVC03(xx-yy).
HTML Version. 0409
BibRef

Cooke, E.[Eddie], Kauff, P.[Peter], Sikora, T.[Thomas],
Multi-view synthesis: A novel view creation approach for free viewpoint video,
SP:IC(21), No. 6, July 2006, pp. 476-492.
Elsevier DOI Image-based rendering; Free viewpoint video; Multi-view synthesis 0606
BibRef

Cooke, E., O'Connor, N.E.,
Multiple Image View Synthesis for Free Viewpoint Video Applications,
ICIP05(I: 1029-1032).
IEEE DOI 0512
BibRef

Tanimoto, M.[Masayuki],
Overview of free viewpoint television,
SP:IC(21), No. 6, July 2006, pp. 454-461.
Elsevier DOI 0606
BibRef
And:
FTV (Free-viewpoint TV),
ICIP10(2393-2396).
IEEE DOI 1009
BibRef
Earlier:
FTV (Free Viewpoint Television) for 3D Scene Reproduction and Creation,
3DCINE06(172).
IEEE DOI 0609
BibRef
Earlier:
FTV (Free Viewpoint Television) Creating Ray-Based Image Engineering,
ICIP05(II: 25-28).
IEEE DOI 0512
BibRef

Tanimoto, M.,
FTV standardization in MPEG,
3DTV-CON14(1-4)
IEEE DOI 1409
video coding BibRef

Tanimoto, M.[Masayuki],
FTV: Free-viewpoint Television,
SP:IC(27), No. 6, July 2012, pp. 555-570.
Elsevier DOI 1205
BibRef
Earlier:
FTV and all-around 3DTV,
VCIP11(1-4).
IEEE DOI 1201
FTV; Free-viewpoint Television; Ray-space; 100-camera system; VSRS; DERS BibRef

Hua, X.S., Lu, L., Zhang, H.J.,
Photo2Video: A System for Automatically Converting Photographic Series Into Video,
CirSysVideo(16), No. 7, July 2006, pp. 803-819.
IEEE DOI 0608
BibRef

Watanabe, K.[Kiyotaka], Iwai, Y.[Yoshio], Nagahara, H.[Hajime], Yachida, M.[Masahiko], Suzuki, T.[Toshiya],
Video Synthesis with High Spatio-Temporal Resolution Using Motion Compensation and Spectral Fusion,
IEICE(E89-D), No. 7, July 2006, pp. 2186-2196.
DOI Link 0607
BibRef
Earlier:
Video Synthesis with High Spatio-Temporal Resolution Using Motion Compensation and Image Fusion in Wavelet Domain,
ACCV06(I:480-489).
Springer DOI 0601
BibRef

Nagahara, H.[Hajime], Matsunobu, T.[Toru], Iwai, Y.[Yoshio], Yachida, M.[Masahiko], Suzuki, T.[Toshiya],
High-resolution Video Generation Using Morphing,
ICPR06(IV: 338-341).
IEEE DOI 0609
BibRef

Lee, R.R.[Ruen-Rone], Lu, C.Y.[Chung-Yen],
Method and apparatus for controlling a stereo video display with non-stereo video source,
US_Patent7,126,990, Oct 24, 2006
WWW Link. BibRef 0610

Choudhury, B.[Biswarup], Pandey, A.[Aviral], Chandran, S.[Sharat],
Efficient image updates using light fields,
PRL(28), No. 3, 1 February 2007, pp. 375-383.
Elsevier DOI 0701
Image-based rendering; Walkthroughs; Virtual reality; Visualization; Rendering BibRef

Choudhury, B.[Biswarup], Singla, D.[Deepali], Chandran, S.[Sharat],
Real-Time Camera Walks Using Light Fields,
ICCVGIP06(321-332).
Springer DOI 0612
BibRef

Waschbusch, M.[Michael], Wurmlin, S.[Stephan], Cotting, D.[Daniel], Gross, M.[Markus],
Point-sampled 3D video of real-world scenes,
SP:IC(22), No. 2, February 2007, pp. 203-216.
Elsevier DOI 0704
3D video; Free-viewpoint video; Scene acquisition; Point-based graphics BibRef

Goldlucke, B.[Bastian], Ihrke, I.[Ivo], Linz, C.[Christian], Magnor, M.A.[Marcus A.],
Weighted Minimal Hypersurface Reconstruction,
PAMI(29), No. 7, July 2007, pp. 1194-1208.
IEEE DOI 0706
Energy minimization approach. Reconstruct from video. BibRef

Linz, C.[Christian], Goldlücke, B.[Bastian], Magnor, M.A.[Marcus A.],
A Point-Based Approach to PDE-Based Surface Reconstruction,
DAGM06(729-738).
Springer DOI 0610
BibRef

Meyer, B.[Benjamin], Lipski, C.[Christian], Scholz, B.[Bjoern], Magnor, M.A.[Marcus A.],
Real-time Free-Viewpoint Navigation from Compressed Multi-Video Recordings,
3DPVT10(xx-yy).
WWW Link. 1005
BibRef

Goldlücke, B.[Bastian], Magnor, M.A.[Marcus A.],
Spacetime-Continuous Geometry Meshes from Multi-View Video Sequences,
ICIP05(I: 625-628).
IEEE DOI 0512
BibRef
Earlier: A2, A1:
Spacetime-coherent geometry reconstruction from multiple video streams,
3DPVT04(365-372).
IEEE DOI 0412
BibRef
Earlier:
Space-Time Isosurface Evolution for Temporally Coherent 3D Reconstruction,
CVPR04(I: 350-355).
IEEE DOI 0408
BibRef
Earlier:
Real-time microfacet billboarding for free-viewpoint video rendering,
ICIP03(III: 713-716).
IEEE DOI 0312
BibRef

Goldlücke, B.[Bastian], Aubry, M.[Mathieu], Kolev, K.[Kalin], Cremers, D.[Daniel],
A Super-Resolution Framework for High-Accuracy Multiview Reconstruction,
IJCV(106), No. 2, January 2014, pp. 172-191.
Springer DOI 1402
BibRef
Earlier: A1, A4, Only: DAGM09(342-351).
Springer DOI 0909
Award, GCPR. BibRef

Yea, S.H.[Se-Hoon], Vetro, A.[Anthony],
View synthesis prediction for multiview video coding,
SP:IC(24), No. 1-2, January 2009, pp. 89-100.
Elsevier DOI 0902
BibRef
Earlier:
View Synthesis Prediction for Rate-Overhead Reduction in FTV,
3DTV08(145-148).
IEEE DOI 0805
BibRef
Earlier:
RD-Optimized View Synthesis Prediction for Multiview Video Coding,
ICIP07(I: 209-212).
IEEE DOI 0709
Multiview video coding; View synthesis; Prediction; Depth; 3DTV; Free-viewpoint video BibRef

Vetro, A.[Anthony],
Frame compatible formats for 3D video distribution,
ICIP10(2405-2408).
IEEE DOI 1009
BibRef

Ince, S.[Serdar], Martinian, E.[Emin], Yea, S.H.[Se-Hoon], Vetro, A.[Anthony],
Depth Estimation for View Synthesis in Multiview Video Coding,
3DTV07(1-4).
IEEE DOI 0705
BibRef

Oh, K.J.[Kwan-Jung], Yea, S.H.[Se-Hoon], Vetro, A.[Anthony], Ho, Y.S.[Yo-Sung],
Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video,
IJIST(20), No. 4, December 2010, pp. 378-390.
DOI Link 1011
BibRef

Tian, D.[Dong], Vetro, A.[Anthony], Brand, M.[Matthew],
A trellis-based approach for robust view synthesis,
ICIP11(605-608).
IEEE DOI 1201
BibRef

Müller, K.[Karsten], Smolic, A.[Aljoscha], Dix, K.[Kristina], Merkle, P.[Philipp], Kauff, P.[Peter], Wiegand, T.[Thomas],
View Synthesis for Advanced 3D Video Systems,
JIVP(2008), No. 2008, pp. xx-yy.
DOI Link 0903
BibRef

Müller, K.[Karsten], Smolic, A.[Aljoscha], Merkle, P.[Philipp], Kaspar, B., Eisert, P., Wiegand, T.,
3D reconstruction of natural scenes with view-adaptive multi-texturing,
3DPVT04(116-123).
IEEE DOI 0412
BibRef

Smolic, A.[Aljoscha], Müller, K.[Karsten], Merkle, P.[Philipp], Rein, T., Kautzner, M., Eisert, P., Wiegand, T.,
Free viewpoint video extraction, representation, coding, and rendering,
ICIP04(V: 3287-3290).
IEEE DOI 0505
BibRef

Smolic, A.[Aljoscha],
3D video and free viewpoint video: From capture to display,
PR(44), No. 9, September 2011, pp. 1958-1968.
Elsevier DOI 1106
3D video; Stereo video; Free viewpoint video; 3DTV BibRef

Li, W.F.[Wen-Feng], Zhou, J.[Jin], Li, B.X.[Bao-Xin], Sezan, M.I.[M. Ibrahim],
Virtual View Specification and Synthesis for Free Viewpoint Television,
CirSysVideo(19), No. 4, April 2009, pp. 533-546.
IEEE DOI 0906
BibRef
Earlier:
Virtual View Specification and Synthesis in Free Viewpoint Television Application,
3DPVT06(464-471).
IEEE DOI 0606
BibRef

Chan, S.C.[Shing-Chow], Ng, K.T.[King-To], Gan, Z.F.[Zhi-Feng], Chan, K.L.[Kin-Lok], Shum, H.Y.[Heung-Yeung],
The plenoptic video,
CirSysVideo(15), No. 12, December 2005, pp. 1650-1659.
IEEE DOI 0601
BibRef

Zhu, Z.Y.[Zhen-Yu], Zhang, S.[Shuai], Chan, S.C.[Shing-Chow], Shum, H.Y.[Heung-Yeung],
Object-Based Rendering and 3-D Reconstruction Using a Moveable Image-Based System,
CirSysVideo(22), No. 10, October 2012, pp. 1405-1419.
IEEE DOI 1210
BibRef

Chan, S.C., Gan, Z.F., Ng, K.T., Ho, K.L., Shum, H.Y.,
An Object-Based Approach to Image/Video-Based Synthesis and Processing for 3-D and Multiview Televisions,
CirSysVideo(19), No. 6, June 2009, pp. 821-831.
IEEE DOI 0906
BibRef

Ng, K.T.[King-To], Wu, Q.[Qing], Chan, S.C.[Shing-Chow], Shum, H.Y.[Heung-Yeung],
Object-Based Coding for Plenoptic Videos,
CirSysVideo(20), No. 4, April 2010, pp. 548-562.
IEEE DOI 1003
BibRef
Earlier: A2, A1, A3, A4:
On Object-Based Compression for a Class of Dynamic Image-Based Representations,
ICIP05(III: 405-408).
IEEE DOI 0512
BibRef

Gan, Z.F.[Zhi-Feng], Chan, S.C.[Shing-Chow], Shum, H.Y.[Heung-Yeung],
Object tracking and matting for a class of dynamic image-based representations,
AVSBS05(81-86).
IEEE DOI 0602
BibRef

Starck, J., Maki, A., Nobuhara, S., Hilton, A., Matsuyama, T.,
The Multiple-Camera 3-D Production Studio,
CirSysVideo(19), No. 6, June 2009, pp. 856-869.
IEEE DOI 0906
BibRef

Yeo, C.H.[Chuo-Hao], Ramchandran, K.[Kannan],
Robust Distributed Multiview Video Compression for Wireless Camera Networks,
IP(19), No. 4, April 2010, pp. 995-1008.
IEEE DOI 1003
BibRef

Yeo, C.H.[Chuo-Hao], Wang, J.J.[Jia-Jun], Ramchandran, K.[Kannan],
View Synthesis for Robust Distributed Video Compression in Wireless Camera Networks,
ICIP07(III: 21-24).
IEEE DOI 0709
BibRef

Tanimoto, M.[Masayuki], Tehrani, M.P., Fujii, T.[Toshiaki], Yendo, T.[Tomohiro],
Free-Viewpoint TV,
SPMag(28), No. 1, 2011, pp. 67-76.
IEEE DOI 1101
Survey article. BibRef

Inoue, T., Fukushima, N., Ishibashi, Y.,
Non-essentiality of correlation between image and depth map in free viewpoint image coding: Accurate depth map case,
3DTV-CON14(1-4)
IEEE DOI 1409
filtering theory BibRef

Fukushima, N., Kodera, N., Ishibashi, Y., Tanimoto, M.,
Comparison between blur transfer and blur re-generation in depth image based rendering,
3DTV-CON14(1-4)
IEEE DOI 1409
channel estimation BibRef

Kodera, N., Fukushima, N., Ishibashi, Y.,
Filter based alpha matting for depth image based rendering,
VCIP13(1-6)
IEEE DOI 1402
filtering theory BibRef

Fukushima, N.[Norishige], Fujii, T.[Toshiaki], Ishibashi, Y.[Yutaka], Yendo, T.[Tomohiro], Tanimoto, M.[Masayuki],
Real-time free viewpoint image rendering by using fast multi-pass dynamic programming,
3DTV10(1-4).
IEEE DOI 1006
BibRef

Chapter on 3-D Object Description and Computation Techniques, Surfaces, Deformable, View Generation, Video Conferencing continues in
Interactive Video View Rendering .


Last update:Oct 20, 2025 at 16:58:17