Granted Patent
B2
US 12,206,908 · App. 18/652,375 · Granted Jan 21, 2025
Directed interpolation and data post-processing
Inventors:
Alexandros Tourapis (Los Gatos, CA); Athanasios Leontaris (Mountain View, CA); Peshala V. Pahalawatta (Burbank, CA); Kevin J. Stec (Los Angeles, CA)
Assignee:
DOLBY LABORATORIES LICENSING CORPORATION
H04N19/85H04N7/0102H04N7/0117H04N7/0135H04N13/161H04N13/172H04N13/178H04N13/218H04N19/117H04N19/154H04N19/169H04N19/17H04N19/172H04N19/174H04N19/176H04N19/423H04N19/44H04N19/587H04N19/597H04N19/70H04N19/80H04N19/86H04N19/865H04N19/895H04N21/4347H04N13/10H04N19/40H04N19/89
View Patent ↗
Loading inventors, assignments & file history…
Abstract
An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
Claims (14)
1. A post-processing device, comprising:
a decoder for decoding a video bitstream, the decoder configured to:
receive the video bitstream comprising at least one region comprising two images;
receive metadata from the video bitstream indicating a width and height of an image of the two images;
receive first recommended information in the video bitstream identifying a first post-decoding process to be applied to the at least one region, the first post-decoding process being a spatial process;
receive second recommended information in the video bitstream identifying a second post-decoding process to be applied to the at least one region;
disregard the first recommended information without applying the first post-decoding process to the at least one region; and
apply the second post-decoding process identified by the second recommended information to the at least one region,
wherein the video bitstream further comprises a second region different from the at least one region, and
wherein the second post-decoding process is not applied to the second region.
2. The post-processing device of claim 1 , wherein the second post-decoding process is related to de-blocking.
3. The post-processing device of claim 1 , wherein the second post-decoding process maps the at least one region to a target device.
4. The post-processing device of claim 1 , wherein the second post-decoding process was selected during studio work prior to mastering the video bitstream.
5. The post-processing device of claim 1 , wherein the first post-decoding process is at least one of de-interleaving and upsampling.
Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST
Recorded Aug 22, 2024
From: TOURAPIS, ALEXANDROS; LEONTARIS, ATHANASIOS; PAHALAWATTA, PESHALA; STEC, KEVIN
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 068368/0770 →
Continuity (10)
Continuation
13255308
Provisional Application
61170995
· Apr 20, 2009
References Cited (180)
US 4027333A
· Kaiser
· 1977
[cited by applicant]
US 4523223A
· Lueder
· 1985
[cited by applicant]
US 4985767A
· Haghiri
· 1991
[cited by applicant]
US 5416510A
· Lipton
· 1995
[cited by applicant]
US 5638498A
· Tyler
· 1997
[cited by applicant]
US 5650860A
· Uz
· 1997
[cited by applicant]
US 5742346A
· Sievers
· 1998
[cited by applicant]
US 5818535A
· Asnis
· 1998
[cited by applicant]
US 5915067A
· Tomoyuki
· 1999
[cited by applicant]
US 5966468A
· Fujimoto
· 1999
[cited by applicant]
US 6055012A
· Haskell
· 2000
[cited by applicant]
US 6118486A
· Reitmeier
· 2000
[cited by applicant]
US 6128041A
· Han
· 2000
[cited by applicant]
US 6134269A
· Puri
· 2000
[cited by applicant]
US 6144701A
· Chiang
· 2000
[cited by applicant]
US 6249610B1
· Matsumoto
· 2001
[cited by applicant]
US 6295089B1
· Hoang
· 2001
[cited by applicant]
US 6332043B1
· Ogata
· 2001
[cited by applicant]
US 6466624B1
· Fogg
· 2002
[cited by applicant]
US 6661463B1
· Geshwind
· 2003
[cited by applicant]
US 6792152B1
· Shibata et al.
· 2004
[cited by applicant]
US 6804403B1
· Wang
· 2004
[cited by applicant]
US 6909745B1
· Puri
· 2005
[cited by applicant]
US 7162080B2
· Chui
· 2007
[cited by applicant]
US 7203234B1
· Zeng
· 2007
[cited by applicant]
US 7397959B1
· Volkoff
· 2008
[cited by applicant]
US 7421127B2
· Bruls et al.
· 2008
[cited by applicant]
US 7499492B1
· Ameres
· 2009
[cited by applicant]
US 7639741B1
· Holt et al.
· 2009
[cited by applicant]
US 7733819B2
· Lee
· 2010
[cited by applicant]
US 7881552B1
· Gerber
· 2011
[cited by applicant]
US 8218082B2
· Chiu
· 2012
[cited by applicant]
US 8363724B2
· Su
· 2013
[cited by applicant]
US 8373744B2
· Akka
· 2013
[cited by applicant]
US 8462196B2
· Kim
· 2013
[cited by applicant]
US 8487982B2
· Lipton
· 2013
[cited by applicant]
US 8879857B2
· Vijayalakshmi
· 2014
[cited by applicant]
US 9445116B2
· Pandit
· 2016
[cited by applicant]
US 20010022887A1
· Lee
· 2001
[cited by applicant]
US 20020051491A1
· Challapali
· 2002
[cited by applicant]
US 20020085219A1
· Ramamoorthy
· 2002
[cited by applicant]
US 20030190079A1
· Penain
· 2003
[cited by applicant]
US 20040218269A1
· Divelbiss
· 2004
[cited by applicant]
US 20050018771A1
· Bourge
· 2005
[cited by applicant]
US 20050200757A1
· Pica
· 2005
[cited by applicant]
US 20050259113A1
· Endo
· 2005
[cited by applicant]
US 20060023782A1
· Cai
· 2006
[cited by applicant]
US 20060029136A1
· Cieplinski
· 2006
[cited by applicant]
US 20060282855A1
· Margulis
· 2006
[cited by applicant]
US 20070110155A1
· Sung
· 2007
[cited by applicant]
US 20070147514A1
· Yamaguchi
· 2007
[cited by applicant]
US 20070160134A1
· Segall
· 2007
[cited by applicant]
US 20080036854A1
· Elliott
· 2008
[cited by applicant]
US 20080095235A1
· Hsiang
· 2008
[cited by applicant]
US 20080170753A1
· Park
· 2008
[cited by applicant]
US 20090003435A1
· Cho
· 2009
[cited by applicant]
US 20090060324A1
· Ballerini
· 2009
[cited by applicant]
US 20090142041A1
· Nagasawa
· 2009
[cited by applicant]
US 20090174704A1
· Sellers
· 2009
[cited by applicant]
US 20100260268A1
· Cowan
· 2010
[cited by applicant]
US 20110135005A1
· Tourapis et al.
· 2011
[cited by applicant]
US 20170324959A1
· Olivier
· 2017
[cited by applicant]
US 20190132600A1
· Francois
· 2019
[cited by applicant]
CN 1254433
· 2000
[cited by applicant]
CN 2407534
· 2000
[cited by applicant]
CN 1367611
· 2002
[cited by applicant]
CN 1492687
· 2004
[cited by applicant]
CN 1875635
· 2006
[cited by applicant]
CN 201066898
· 2008
[cited by applicant]
CN 101288303
· 2008
[cited by applicant]
DE 19619598
· 1997
[cited by applicant]
EP 0306448
· 1989
[cited by applicant]
EP 0250534
· 1991
[cited by applicant]
EP 1845729
· 2007
[cited by applicant]
JP H04183186
· 1992
[cited by applicant]
JP 06022290
· 1994
[cited by applicant]
JP H9215009
· 1997
[cited by applicant]
JP H09084002
· 1998
[cited by applicant]
JP 11018111
· 1999
[cited by applicant]
JP 2004336104
· 2004
[cited by applicant]
WO 2003056843
· 2003
[cited by applicant]
WO 2005120085
· 2005
[cited by applicant]
WO 2006137000
· 2006
[cited by applicant]
WO 2008023917
· 2008
[cited by applicant]
WO 2008127676
· 2008
[cited by applicant]
WO 2008150111
· 2008
[cited by applicant]
WO 2010011557
· 2010
[cited by applicant]
WO 2010039417
· 2010
[cited by applicant]
WO 2010088420
· 2010
[cited by applicant]
Anonymous—“Joint Draft 2.0 of Amendment to ITU-T Rec. H.264: Constrained Baseline Profile and Supplemental Enhancement Information” 30th JVT Meeting Jan. 29, 2009 through Feb. 2, 2009 (12 pgs.).
[cited by applicant]
Bjontegaard, et al., “Adaptive Deblocking Filter”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 7, Jul. 2003, pp. 614-619.
[cited by applicant]
El-Etriby, et al., “Improvement of 3-D Reconstruction by Deformable Stereo Matching Using a Set of Linear Spatial Filters” GVIP Special Issue on Image Retrieval and Representation, Mar. 2006.
[cited by applicant]
Hur, et al., “3D HDTV Relay Broadcast Experiments Using a Terrestrial and Satellite Network in Korea” pp. 1221-1224.
[cited by applicant]
Hutchison, David, “Introducing DLP 3-D TV” pp. 1-5.
[cited by applicant]
Hutchison, et al., “The Design and Implementation of a Stereoscopic Microdisplay Television” IEEE Transactions on Consumer Electronics, IEEE Service Center, New York, NY, vol. 54, No. 2, May 1, 2008, pp. 254-261.
[cited by applicant]
ITU-T Telecommunication Standardization Sector of ITU, “Advanced Video Coding for Generic Audiovisual Services” H.264, May 2003.
[cited by applicant]
ITU-T, H.264 “Advanced Video Coding for Generic Audiovisual Services” Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual services—Coding of Moving Video, Mar. 2009.
[cited by applicant]
Kim, et al., “New Coding Tools for Illumination and Focus Mismatch Compensation in Multiview Video Coding” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 11, Nov. 2007, pp. 1519-1535.
[cited by applicant]
Liu, et al., “H.264/SVC Error Resilience Strategies for 3G Video Service” Image Analysis and Signal Processing, 2009, International Conference on IEEE, Piscataway, NJ, USA, Apr. 11, 2009, pp. 207-211.
[cited by applicant]
M Tagliasacchi, G. Prandi, & S. Tubaro, “Symmetric Distributed Coding of Stereo Video Sequences”, 2 2007 IEEE Int'l Conf. on Image Processing (ICIP 2007) 29-32 (2007).
[cited by applicant]
McCormick, et al., “Implementation of Stereoscopic and Dualview Images on a Micro Display High Definition Television” 3-DTV-Con 2008, Istanbul, Turkey, May 208, pp. 33-36.
[cited by applicant]
SMPTE 421M-2006 “VC-1 Compressed Video Bitstream Format and Decoding Process” Apr. 2006.
[cited by applicant]
Steffen Wittmann et al: “Transmission of Post-Filter Hints for Video Coding Schemes” Image Processing , 2007. ICIP 2007, IEEE International Conference on, IEEE, PI, Sep. 1, 2007 (Sep. 1, 2007), pp. I-81.
[cited by applicant]
Suhring, JVT reference software version JM14.2.
[cited by applicant]
Sullivan, G., et al.,“Meeting Report of the 29th JVT Meeting”, Joint Video Team of ISO/IEC JTC1/SC29/WG11 and ITU-T, etc. Oct. 13-17, 2008 in Busan, Korea. (26 pgs.).
[cited by applicant]
Tagliasacchi, M. et al “Symmetric Distributed Coding of Stereo Video Sequences” IEEE International Conference on Image Processing vol. 2, pp. II-29-II-32, Sep. 16, 2007-Oct. 19, 2007.
[cited by applicant]
Tamhankar, et al., “An Overview of H264/MPEG-4 part 10” Video/Image Processing and Multimedia Communications, 2003. 4th Eurasian P Conferenced Focused on Jul. 2-5, 2003, Piscataway, NJ, vol. 1, pp. 1-51.
[cited by applicant]
Tourapis A M et al: “Format Extensions to the Spatiall Interleaved Pictures SEI message” 30. JVT Meeting; Jan. 29, 2009-Feb. 2, 2009; Geneva, ; (Joint Video Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), , Jan. 31, 20…
[cited by applicant]
Tourapis, et al., “SEI Message for Checkerboard Multiplexed Video Data” JVT of ISO/IEC MPEG & ITU-T VCEG JVT 2010, Oct. 12, 2008, pp. 1-5.
[cited by applicant]
Tseng, et al., “Compatible Video Coding of Stereoscopic Sequences Using MPEG-2's Scalability and Interlaced Structure” 1994.
[cited by applicant]
Vetro, Anthony, “MVC Profile/Level Definitions of Stereo” JVT Meeting of ISO/IEC MPEG & ITU-T VCEG, 28th meeting Jul. 20-25, 2008.
[cited by applicant]
Wang, et al, “A new motion compensation design for H.264/AVC decoder” 2005 IEEE Int'l Symposium on Circuits & Sys., May 2005, 4558-4561.
[cited by applicant]
Wittmann, et al., “Transmission of Post-Filter Hints for Video Coding Schemes” Image Processing, 2007, IEEE International Conference on IEEE, Sep. 1, 2007, pp. 1-81.
[cited by applicant]
Wittmann, S. et al “SEI Message on Post-Filter Hints for High Fidelity” JVT of ISO/IEC MPEG & ITU-T VCEG, 20th Meeting: Klagenfurt, Austria Jul. 17-21, 2006.
[cited by applicant]
Yunpeng Liu Te Al: “H.264/SVC error resilience strategies for 3G video service” Image Analysis and Signal Processing, 2009. IASP 2009. International Conference on, IEEE, Piscataway, NJ, USA, Apr. 11, 2009 (Apr. 11, 2009…
[cited by applicant]