IP Library Granted Patent US 12,652,385
Granted Patent B2
US 12,652,385 · App. 18/884,282 · Granted Jun 9, 2026

Effective wedgelet partition coding

Inventors: Philipp Merkle (Berlin, DE); Christian Bartnik (Berlin, DE); Haricharan Lakshman (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Mueller (Berlin, DE); Thomas Wiegand (Berlin, DE); Gerhard Tech (Berlin, DE)
Assignee: Dolby Video Compression, LLC
H04N19/105H04N19/119H04N19/124H04N19/157H04N19/167H04N19/174H04N19/176H04N19/44H04N19/46H04N19/593H04N19/597H04N19/70H04N19/82H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,652,385
App. No.
18/884,282
Granted
Jun 9, 2026
Kind
B2
Abstract

Wedgelet separation lines of neighboring blocks are predicted from each other by aligning the wedgelet separation lines of such neighboring blocks to each other, thereby reducing the side information coding rate that may be used.

Claims (51)

1 . A decoder for reconstructing a sample array of a video from a data stream, the decoder configured to:

select a set of wedgelet patterns to decode a block of the sample array of the video from at least one lookup array of wedgelet patterns based on a size of the block, wherein each wedgelet pattern of the set includes a two-dimensional array having values that represent a division of the block into two wedgelet portions separated by a line corresponding to the wedgelet pattern;

extract, from the data stream, an index value indicating a position of a block wedgelet pattern in the set of wedgelet patterns, wherein the index value is entropy coded using arithmetic coding;

obtain the block wedgelet pattern from the set of wedgelet patterns based on the index value; and

decode the block based on the two wedgelet portions yielded by the line corresponding to the block wedgelet pattern.

2 . The decoder of claim 1 , wherein each wedgelet pattern indicates an orientation of the line corresponding to the wedgelet pattern.

3 . The decoder of claim 1 , wherein a number of wedgelet patterns in the set is based on the size of the block.

4 . The decoder of claim 1 , wherein:

the decoder is configured to determine a plurality of sets of wedgelet patterns; and

each set of the plurality of sets corresponds to one of a plurality of block sizes of the sample array of the video.

5 . The decoder of claim 1 , wherein each wedgelet pattern of the set is a two-dimensional array including binary-valued elements.

6 . The decoder of claim 1 , wherein the index value is represented in a fixed number of bits in the data stream.

7 . The decoder of claim 1 , wherein the decoder is configured to:

extract, from the data stream, a mode syntax element; and

decode the mode syntax element to determine whether the index value is used to decode the block.

8 . The decoder of claim 1 , wherein, to determine a first wedgelet pattern of the set of wedgelet patterns, the first wedgelet pattern being an array having elements all with a first binary value, the decoder is configured to:

update first elements of the array from the first binary value to a second binary value, wherein the first elements form a line joining start and end positions of the first wedgelet pattern;

determine whether an existing wedgelet pattern in the set of wedgelet patterns is identical to, or is an inverse of, the first wedgelet pattern based on a comparison of the elements of the existing wedgelet pattern and the first wedgelet pattern; and

responsive to a determination that the existing wedgelet pattern is not identical to and is not an inverse of the first wedgelet pattern, add the first wedgelet pattern to the set of wedgelet patterns.

9 . The decoder of claim 1 , wherein:

each wedgelet pattern of the set is associated with a resolution of start and end positions of the corresponding wedgelet pattern; and

the resolution is based on the size of the block.

10 . The decoder of claim 1 , wherein the decoder is configured to, in decoding the block, predict the block by assigning a first constant partition value to samples of the sample array positioned within a first of the two wedgelet portions and assigning a second constant partition value to samples of the sample array positioned within a second of the two wedgelet portions.

11 . The decoder of claim 10 , wherein:

the sample array is a depth map; and

the decoder is configured to use a reference quantization step size to reconstruct a texture sample array from the data stream, with which the depth map is associated.

12 . The decoder of claim 1 , wherein the decoder is further configured to use the block as a reference in a prediction loop of the decoder.

13 . A method for reconstructing a sample array of a video from a data stream, the method comprising:

selecting a set of wedgelet patterns to decode a block of the sample array of the video from at least one lookup array of wedgelet patterns based on a size of the block, wherein each wedgelet pattern of the set includes a two-dimensional array having values that represent a division of the block into two wedgelet portions separated by a line corresponding to the wedgelet pattern;

extracting, from the data stream, an index value indicating a position of a block wedgelet pattern in the set of wedgelet patterns, wherein the index value is entropy coded using arithmetic coding;

obtaining the block wedgelet pattern from the set of wedgelet patterns based on the index value; and

decoding the block based on the two wedgelet portions yielded by the line corresponding to the block wedgelet pattern.

14 . The method of claim 13 , wherein each wedgelet pattern indicates an orientation of the line corresponding to the wedgelet pattern.

15 . The method of claim 13 , wherein a number of wedgelet patterns in the set is based on the size of the block.

16 . The method of claim 13 , further comprising determining a plurality of sets of wedgelet patterns, wherein each set of the plurality of sets corresponds to one of a plurality of block sizes of the sample array of the video.

17 . The method of claim 13 , wherein each wedgelet pattern of the set is a two-dimensional array including binary-valued elements.

18 . The method of claim 13 , wherein the index value is represented in a fixed number of bits in the data stream.

19 . The method of claim 13 , further comprising:

extracting, from the data stream, a mode syntax element; and

decoding the mode syntax element to determine whether the index value is used to decode the block.

20 . The method of claim 13 , wherein, to determine a first wedgelet pattern of the set of wedgelet patterns, the first wedgelet pattern being an array having elements all with a first binary value, the method further comprises:

updating first elements of the array from the first binary value to a second binary value, wherein the first elements form a line joining the start and end positions of the first wedgelet pattern;

determining whether an existing wedgelet pattern in the set of wedgelet patterns is identical to, or is an inverse of, the first wedgelet pattern based on a comparison of the elements of the existing wedgelet pattern and the first wedgelet pattern; and

responsive to a determination that the existing wedgelet pattern is not identical to and is not an inverse of the first wedgelet pattern, adding the first wedgelet pattern to the set of wedgelet patterns.

21 . An encoder for encoding a sample array of a video into a data stream, the encoder configured to:

select a set of wedgelet patterns to code a block of the sample array of the video from at least one lookup array of wedgelet patterns based on a size of the block, wherein each wedgelet pattern of the set includes a two-dimensional array having values that represent division of the block into two wedgelet portions separated by a line corresponding to the wedgelet pattern;

select, for the block of the sample array of the video, a block wedgelet pattern from the set of wedgelet patterns;

encode the block based at least on the two wedgelet portions yielded by the line corresponding to the block wedgelet pattern; and

entropy encode, into the data stream, an index value indicating a position of the block wedgelet pattern in the set of wedgelet patterns, wherein the index value is entropy-encoded using arithmetic coding.

22 . A method for storing data associated with a video, comprising:

storing, on a digital storage medium, a data stream from which a sample array of a video is reconstructed by a method according to claim 13 .

Assignments (1)
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069451/0262 →
Continuity (8)
Continuation 18297312 · Apr 7, 2023
Continuation 17131333 · Dec 22, 2020
Continuation 16736845 · Jan 8, 2020
Continuation 15723327 · Oct 3, 2017
Continuation 14273609 · May 9, 2014
Continuation PCTEP2012072324 · Nov 9, 2012
Provisional Application 61558625 · Nov 11, 2011
Related Publication 20250008092A1 · Jan 2, 2025
References Cited (105)
US 6243416B1 · Matsushiro et al. · 2001 [cited by applicant]
US 6404817B1 · Saha et al. · 2002 [cited by applicant]
US 6944351B2 · Kim et al. · 2005 [cited by applicant]
US 7596279B2 · Sugimoto et al. · 2009 [cited by applicant]
US 7756348B2 · Mukherjee et al. · 2010 [cited by applicant]
US 8249273B2 · Inoda et al. · 2012 [cited by applicant]
US 8666177B2 · Chen et al. · 2014 [cited by applicant]
US 10574982B2 · Merkle et al. · 2020 [cited by applicant]
US 20020094125A1 · Guo · 2002 [cited by applicant]
US 20040101059A1 · Joch et al. · 2004 [cited by applicant]
US 20050038837A1 · Marpe et al. · 2005 [cited by applicant]
US 20050105615A1 · El-Maleh et al. · 2005 [cited by applicant]
US 20060078051A1 · Liang et al. · 2006 [cited by applicant]
US 20080101707A1 · Mukherjee et al. · 2008 [cited by applicant]
US 20080285806A1 · Kokaram · 2008 [cited by applicant]
US 20090103615A1 · Francois et al. · 2009 [cited by applicant]
US 20090214133A1 · Aoyama · 2009 [cited by applicant]
US 20090225834A1 · Song et al. · 2009 [cited by applicant]
US 20100208827A1 · Divorra Escoda et al. · 2010 [cited by applicant]
US 20110164677A1 · Lu et al. · 2011 [cited by applicant]
US 20110206132A1 · Bivolarsky et al. · 2011 [cited by applicant]
US 20110274166A1 · Jeon et al. · 2011 [cited by applicant]
US 20110274176A1 · Panusopone et al. · 2011 [cited by applicant]
US 20120008684A1 · Lee et al. · 2012 [cited by applicant]
US 20120163470A1 · Wu et al. · 2012 [cited by applicant]
US 20120200669A1 · Lai · 2012 [cited by examiner]
US 20130027230A1 · Marpe et al. · 2013 [cited by applicant]
US 20130034171A1 · Winken et al. · 2013 [cited by applicant]
US 20130147915A1 · Wiegand et al. · 2013 [cited by applicant]
US 20140079132A1 · Amon · 2014 [cited by applicant]
US 20140140400A1 · George et al. · 2014 [cited by applicant]
CN 1777289A · 2006 [cited by applicant]
CN 101502120A · 2009 [cited by applicant]
CN 101536528A · 2009 [cited by applicant]
CN 101609548A · 2009 [cited by applicant]
CN 101731012A · 2010 [cited by applicant]
CN 101933329A · 2010 [cited by applicant]
CN 101969566A · 2011 [cited by applicant]
CN 101453684B · 2014 [cited by applicant]
EP 1924075A2 · 2008 [cited by applicant]
EP 2052546A1 · 2009 [cited by applicant]
EP 2521357A1 · 2012 [cited by applicant]
EP 2777285B1 · 2014 [cited by applicant]
EP 2860977A1 · 2015 [cited by applicant]
EP 3349464A1 · 2018 [cited by applicant]
JP H01303888A · 1989 [cited by applicant]
JP H06153167A · 1994 [cited by applicant]
JP H07099581A · 1996 [cited by applicant]
JP H08298665A · 1996 [cited by applicant]
JP H09275565A · 1997 [cited by applicant]
JP 2004072732A · 2004 [cited by applicant]
JP 2008516561A · 2008 [cited by applicant]
JP 2009017502A · 2009 [cited by applicant]
JP 2009206713A · 2009 [cited by applicant]
JP 2009147968A · 2009 [cited by applicant]
JP 2014509480A · 2014 [cited by applicant]
JP 2015525988A · 2015 [cited by applicant]
JP D799581A · 2017 [cited by applicant]
JP 2019051540A · 2019 [cited by applicant]
JP 5788699A · 2020 [cited by applicant]
JP 5814783B2 · 2021 [cited by applicant]
JP 7126329B2 · 2022 [cited by applicant]
KR 1020110117075A · 2011 [cited by applicant]
WO 2006033953A1 · 2006 [cited by applicant]
WO 2008007913A1 · 2008 [cited by applicant]
WO 2010082463A1 · 2010 [cited by applicant]
WO 2010151334A1 · 2010 [cited by applicant]
WO 2011046607A2 · 2011 [cited by applicant]
WO 2011066672A1 · 2011 [cited by applicant]
WO 2011074896A2 · 2011 [cited by applicant]
WO 2011127966A1 · 2011 [cited by applicant]
WO 2011128365A1 · 2011 [cited by applicant]
WO 2012020092A1 · 2012 [cited by applicant]
WO 2012147740A1 · 2012 [cited by applicant]
WO 2013032423A1 · 2013 [cited by applicant]
Houji BI, et al. (Editors), “New Generation Video Compression Coding Standard—H.264/AVC” (Second Edition), Nov. 30, 2009. [cited by applicant]
Smolic, A. et al., “Development of a New MPEG Standard for Advanced 3D Video Applications”, Proc. IEEE ISPA, pp. 400-407, 2009. [cited by applicant]
Makin, M. et al., “Rate-Distortion Optimized Image Compression Using Wedgelets”, Proc. IEEE ICIP, pp. 111-237-111-240, 2002. [cited by applicant]
Yang, W. et al., “An MPEG-4-Cornpatible Stereoscopic/Multiview Video Coding Scheme”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, No. 2, pp. 286-290, 2006. [cited by applicant]
Zhang, Y. et al., “Motion Compensation Using Polyline Based Block Partition”, 2nd International Congress on Image and Signal Processing, Oct. 17-19, 2009, 5 pages. [cited by applicant]
Ferreira et al., “Efficiency improvements for geometric-partition-based video coder”, Proc. IEEE Int. Cont. Image Process, Cairo, Egypt, Nov. 2009, pp. 1009-1012. [cited by applicant]
Gerhard Tech et al., “30-HEVC Test Model 1”, Joint Collaborative Team on 3D Video Coding Extension Development of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WGII, 1st Meeting Stockholm, SE, Jul. 16-20, 2012, 83 pgs. [cited by applicant]
Christian Bartnik et al., “HEVC extension for Multiview Video Coding and Multiview Video plus Depth Coding”, ITU—Telecommunications standardization sector, Study Group 16, Question 6, Video Coding Experts Group, 44nd Me… [cited by applicant]
Kang 2010 et al. (“Geometry-based Intra block partitioning for efficient intra prediction for depth video coding” 2010 supplied by Applicant). [cited by applicant]
Declaration of Dr. Immanuel Freedman, including Appendix A (CV of Dr. Freedman), Jul. 2, 2024. [cited by applicant]
“On Macroblock Partition for Motion Compensation,” Proceedings of the International Conference on Image Processing, Nov. 2006, Hung, et al. [cited by applicant]
“Masking”, School of Informatics, WebArchive, Sep. 9, 2004, Fisher et al., https://web.archive.org/web/20040909175026 https:/homepages.inf.ed.ac.uk/rbf/HIPR2/mask.htm. [cited by applicant]
“EDM: Electron Direct Methods,” WebArchive, Dec. 15, 2004 (“EDM”) https://web.archive.org/web/20041215233117 http://www.nurnis.northwestem.edu/edrn/documentation/edm.htm. [cited by applicant]
“Binary Image Analysis,” Computer Vision, Mar. 2000, Shapiro et al. [cited by applicant]
“Multiscale Wedgelet Image Analysis: Fast Decompositions and Modeling”, IEEE, 2002, Romberg et al. [cited by applicant]
“Segmentation and Thresholding” CRC Press LLC, 2002. [cited by applicant]
“A Survey of Various Data Compression Techniques,” Apr. 1, 2010, Smith. [cited by applicant]
Marta Karczewicz et al., “Video coding technology proposal to Qualcomm Inc.”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 1st Meeting: Dresden, DE, Apr. 15-23, 2010, D… [cited by applicant]
Davies, T. et al., “Suggestion for a Test Model”, ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 1st Meeting, Document JCI VC-A033, 30 pages, Apr. 15-23, 2010. [cited by applicant]
Escoda, 0. et al., “Geometry-Adaptive Block Partitioning for Video Coding”, Proc. IEEE ICASSP, 2007, pp. 1-657-1-660. [cited by applicant]
Gao, J. et al., “Application of Wedgelet Transform for Image Process”, Proc. IEEE IGACIA, pp. 220-222, 2008. [cited by applicant]
ITU-T Recommendation H.264, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, ISO/IEC JTC 1, 14496-10, 732 pages, Apr. 2013. [cited by applicant]
Kang, M. et al., “Adaptive Geometry-based Intra Prediction for Depth Video Coding”, IEEE International Conference on Multimedia and Expo, Jul. 19, 2010, pp. 1230-1235. [cited by applicant]
Lake. K., “Wedgelets-Based Automatic Object Contour Detection”. Proc. IEEE ICNC. pp. 3664-3668. 2010. [cited by applicant]
Liu, S. et al., “New Depth Coding Techniques with Utilization of Corresponding Video”, IEEE Transactions on Broadcasting, vol. 57, No. 2, Jun. 2011, pp. 551-561. [cited by applicant]
Liu, S. et al., “Sparse Dyadic Mode for Depth Map Compression”, Proc. IEEE ICIP, Sep. 26-29, 2010, pp. 3421-3424. [cited by applicant]
Merkle, P. et al., “3D-CE6.H Related: Fast Wedgelet Search”, ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 1st Meeting, Document JCT2-A0105, 4 pages, Jul. 16-20, 2012. [cited by applicant]
Merkle, P. et al., “The Effects of Multiview Depth Video Compression on Multiview Rendering”, Signal Processing: Image Communication, 24, 2009, pp. 73-88. [cited by applicant]
Merkle, P ., “CE6.H Results on Simplified Wedgelet Search for DMM Modes 1 and 3”, ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2nd Meeting, Document JCT3V-B0039, 7 pages, 2012. [cited by applicant]
Morvan, Y. et al., “Novel Coding Technique for Depth Images using Quadtree Decomposition and Plane Approximation”, Proc. SPIE, vol. 5960,2005, pp. 1187-1194. [cited by applicant]