IP Library › Granted Patent US 12,278,950
Granted Patent B2
US 12,278,950 · App. 18/385,457 · Granted Apr 15, 2025

Block shape adaptive intra prediction directions for quadtree-binary tree

Inventors: Fabrice Leleannec (Betton, FR); Fabien Racape (San Francisco, CA); Gagan Rath (Rennes, FR); Fabrice Urban (Fouillard, FR)
Assignee: INTERDIGITAL VC HOLDINGS, INC.
H04N19/105H04N19/11H04N19/147H04N19/159H04N19/176H04N19/593H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,278,950
App. No.
18/385,457
Granted
Apr 15, 2025
Kind
B2
Abstract

A video encoder or decoder processes portions of video using intra coding and with variable block shapes. Under the general aspects, intra prediction directions are adapted to the block shape or aspect ratio. The general aspects described adaptively replace several conventional angular intra prediction modes with wide-angle intra prediction modes for non-square blocks. The total number of angular directions for any block can remain the same as in prior video coding standards or can be reduced or expanded. To keep the same number of prediction directions, directions along a shorter rectangular edge of a target block are removed but replaced with addition directions along the longer edge of the rectangular target block. For directions with wide angles, reference sample smoothing is performed. Signaling can be provided to inform a corresponding decoder regarding the prediction modes and directions.

Claims (29)

1. A method, comprising:

predicting a video sample belonging to a rectangular block based on at least one sample of a neighboring block lying along a direction based on block shape of the rectangular block, wherein a greater number of prediction directions are available along a longer side of said rectangular block than along a shorter side of said rectangular block; and,

encoding the rectangular block using intra prediction based on the predicted video sample, wherein a mapping of a regular mode to a wide angle mode is performed based on a ratio of block width to block height corresponding to a prediction direction for the rectangular block being encoded and, wherein a fixed number of prediction indices are used to indicate a range of intra prediction directions, an angular prediction mode is mapped to a wide angle mode by a value that corresponds to the target block shape and the mapping of angular modes to wide angle modes is one-to-one, the overall number of intra prediction directions is fixed, the range of intra prediction directions being adapted to a shape of the rectangular block and a range of intra prediction directions extends beyond the prediction directions for a square block, and wherein a reference array of samples above the rectangular block has length of 2W+1 and a reference array of samples left of the rectangular block has height 2H+1, where W is a width of the rectangular block and H is a height of the rectangular block and prediction directions on the longer side of said rectangular block extend to angles ranging from 45 degrees down to −135 degrees.

2. An apparatus for encoding a video block, comprising:

a memory, and

a processor, configured to:

predict a video sample belonging to a rectangular block based on at least one sample of a neighboring block lying along a direction based on block shape of the rectangular block, wherein a greater number of prediction directions are available along a longer side of said rectangular block than along a shorter side of said rectangular block; and,

encode the rectangular block using intra prediction based on the predicted video sample, wherein a mapping of a regular mode to a wide angle mode is performed based on a ratio of block width to block height corresponding to a prediction direction for the rectangular block being encoded and, wherein a fixed number of prediction indices are used to indicate a range of intra prediction directions, an angular prediction mode is mapped to a wide angle mode by a value that corresponds to the target block shape and the mapping of angular modes to wide angle modes is one-to-one, the overall number of intra prediction directions is fixed, the range of intra prediction directions being adapted to a shape of the rectangular block and a range of intra prediction directions extends beyond the prediction directions for a square block, and wherein a reference array of samples above the rectangular block has length of 2W+1 and a reference array of samples left of the rectangular block has height 2H+1, where W is a width of the rectangular block and H is a height of the rectangular block and prediction directions on the longer side of said rectangular block extend to angles ranging from 45 degrees down to −135 degrees.

3. A method, comprising:

predicting a video sample belonging to a rectangular block based on at least one sample of a neighboring reconstructed block lying along a direction based on block shape of the rectangular block, wherein a greater number of prediction directions are available along a longer side of said rectangular block than along a shorter side of said rectangular block; and,

decoding the rectangular block using intra prediction based on the predicted video sample, wherein a mapping of a regular mode to a wide angle mode is performed based on a ratio of block width to block height corresponding to a prediction direction for the rectangular block being encoded and, wherein a fixed number of prediction indices are used to indicate a range of prediction directions, an angular prediction mode is mapped to a wide angle mode by a value that corresponds to the target block shape and the mapping of angular modes to wide angle modes is one-to-one, the overall number of intra prediction directions is fixed, the range of intra prediction directions being adapted to a shape of the rectangular block and a range of intra prediction directions extends beyond the prediction directions for a square block, and wherein a reference array of samples above the rectangular block has length of 2W+1 and a reference array of samples left of the rectangular block has height 2H+1, where W is a width of the rectangular block and H is a height of the rectangular block and prediction directions on the longer side of said rectangular block extend to angles ranging from 45 degrees down to −135 degrees.

4. An apparatus for decoding a video block, comprising:

a memory, and

a processor, configured to:

predict a video sample belonging to a rectangular block based on at least one sample of a neighboring reconstructed block lying along a direction based on block shape of the rectangular block, wherein a greater number of prediction directions are available along a longer side of said rectangular block than along a shorter side of said rectangular block; and,

decode the rectangular block using intra prediction based on the predicted video sample, wherein a mapping of a regular mode to a wide angle mode is performed based on a ratio of block width to block height corresponding to a prediction direction for the rectangular block being encoded and, wherein a fixed number of prediction indices are used to indicate a range of intra prediction directions, an angular prediction mode is mapped to a wide angle mode by a value that corresponds to the target block shape and the mapping of angular modes to wide angle modes is one-to-one, the overall number of intra prediction directions is fixed, the range of intra prediction directions being adapted to a shape of the rectangular block and a range of intra prediction directions extends beyond the prediction directions for a square block, and wherein a reference array of samples above the rectangular block has length of 2W+1 and a reference array of samples left of the rectangular block has height 2H+1, wherein W is a width of the rectangular block and H is a height of the rectangular block and prediction directions on the longer side of said rectangular block extend to angles ranging from 45 degrees down to −135 degrees.

5. The method of claim 1 , wherein there are more prediction samples of neighboring blocks along the longer edge of said rectangular block.

6. The method of claim 1 , wherein directions are added along the longer side of said rectangular block and directions are removed along the shorter side of said rectangular block.

7. The method of claim 1 , wherein prediction modes are signalled using a flag.

8. The method of claim 3 , wherein prediction modes are signalled differently based on whether the mode belongs to a most probable mode list.

9. The method of claim 3 , wherein an index is used to map a prediction mode of the neighboring block to prediction modes of the rectangular block.

10. The method of claim 3 , wherein a rate distortion optimization is performed to find a prediction.

11. The method of claim 3 , wherein prediction directions are added along the longer side of said rectangular block and prediction directions are added along the shorter side of said rectangular block.

12. A device comprising:

an apparatus according to claim 4 ; and

at least one of (i) an antenna configured to receive a signal, the signal including the video block, (ii) a band limiter configured to limit the received signal to a band of frequencies that includes the video block, and (iii) a display configured to display an output.

13. A non-transitory computer readable medium containing data content generated according to the method of claim 1 , for playback using a processor.

14. A signal comprising video data generated according to the method of claim 1 , for playback using a processor.

15. A computer code program stored in a non-transitory computer-readable storage medium comprising instructions which, when the code program is executed by a computer, cause the computer to carry out the method of claim 3 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2023
From: LELEANNEC, FABRICE; RACAPE, FABIEN; RATH, GAGAN; URBAN, FABRICE
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 065930/0360 →
Priority Claims (3)
EP 18305586 · May 14, 2018 · regional
EP 18305963 · Jul 16, 2018 · regional
EP 18306075 · Aug 6, 2018 · regional
Continuity (2)
Continuation 17054561
Related Publication 20240155105A1 · May 9, 2024
References Cited (47)
US 9532058B2 · Chien et al. · 2016 [cited by applicant]
US 10404980B1 · Zhao et al. · 2019 [cited by applicant]
US 11128872B2 · Van der Auwera · 2021 [cited by examiner]
US 11483564B2 · Lee · 2022 [cited by applicant]
US 20110158314A1 · Jeong et al. · 2011 [cited by applicant]
US 20130136175A1 · Wang · 2013 [cited by examiner]
US 20130163664A1 · Guo et al. · 2013 [cited by applicant]
US 20130272381A1 · Guo et al. · 2013 [cited by applicant]
US 20140079121A1 · Song · 2014 [cited by examiner]
US 20140198855A1 · Sole Rojals et al. · 2014 [cited by applicant]
US 20160100191A1 · Mishra et al. · 2016 [cited by applicant]
US 20170094274A1 · Chien et al. · 2017 [cited by applicant]
US 20170094285A1 · Said et al. · 2017 [cited by applicant]
US 20170272759A1 · Seregin et al. · 2017 [cited by applicant]
US 20170374369A1 · Chuang et al. · 2017 [cited by applicant]
US 20180176587A1 · Panusopone et al. · 2018 [cited by applicant]
US 20180195048A1 · Rao · 2018 [cited by applicant]
US 20180288413A1 · Filippov et al. · 2018 [cited by applicant]
US 20190068976A1 · Yamori · 2019 [cited by applicant]
US 20190208200A1 · Galpin et al. · 2019 [cited by applicant]
US 20190356909A1 · Lainema · 2019 [cited by applicant]
US 20190373257A1 · Liu et al. · 2019 [cited by applicant]
US 20200322601A1 · Ko · 2020 [cited by examiner]
US 20210037259A1 · Ko · 2021 [cited by examiner]
US 20210044808A1 · Kim · 2021 [cited by examiner]
CN 102907100 · 2013 [cited by applicant]
CN 103636203 · 2014 [cited by applicant]
KR 101713244 · 2017 [cited by applicant]
PH 12017501445 · 2018 [cited by applicant]
RU 2659733 · 2018 [cited by applicant]
WO 2013023518 · 2013 [cited by applicant]
WO 2018117894 · 2018 [cited by applicant]
WO WO2018117892 · 2018 [cited by applicant]
WO WO2018117894A1 · 2018 [cited by examiner]
WO WO2018127624 · 2018 [cited by applicant]
Wang et al., Overview of the second generation AVS video Coding Standard (AVS2), ZTE Communications, vol. 14, No. 2, Feb. 2, 2016, (Feb. 2, 2016), pp. 3-11—* cited in parent app. [cited by applicant]
Chen, et al., Joint inter-intra Prediction Based on Mode-Variant and Edge-Directed Weighting Approaches in Video Coding, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7422-7… [cited by applicant]
Racape, et al., Wide-Angle Intra Prediction for Non-Square Blocks, Ljubljana, SI 11th Meeting, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 15, 2018—* cited in parent app. [cited by applicant]
Matsuo, et al., Modification of Intra Angular Prediction in HEVC, Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC), 2012 Asia-Pacific, IEEE, Dec. 3, 2012 (Dec. 3, 2012), pp. 1-4—* ci… [cited by applicant]
Huang et al., “EE2/1: Quadtree Plus Binary Tree Structure Integration with JEM Tools”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-C0024, 3rd Meeting, Geneva Swi… [cited by applicant]
Sjoberg et al., Description of SDR and HDR Video Coding Technology Proposal by Ericsson and Nokia, 10. JVET Meeting, Apr. 10, 2018-Apr. 20, 2018, San Diego, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 an… [cited by applicant]
Chen et al., “Further improvements to HMKTA-1.0”, ITU—Telecommunications Standardization Sector, Study Group 16 Question 6, Video Coding Experts Group (VCEG), Document VCEG-AZ07_v2, 52nd Meeting: Jun. 19-26, 2015, Warsa… [cited by applicant]
Anonymous, “Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding”, ITU-T H.265 Telecommunication Standardization Sector of ITU, Recomm… [cited by applicant]
Van Der Auwera et al, “Description of Core Experiment 3: Intra Prediction and Mode Coding”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-J1023_r2, 10th Meeting: San Di… [cited by applicant]
Rivaz et al., AV1 Bitstream & Decoding Process Specification, 2018, The Alliance for Open Media, pp. 1-650—* cited in parent app. [cited by applicant]
Lainema, et al., Intra Coding of the HEVC Standard, IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 1, 2012, pp. 1792-1801—* cited in parent app. [cited by applicant]
Seregin et al., Block Shape Dependent Intra Mode Coding, Document: JVET-G0159, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting: Torino, IT, Jul. 13-21, 2017—* cited in p… [cited by applicant]