IP Library Granted Patent US 12,501,053
Granted Patent B2
US 12,501,053 · App. 17/328,866 · Granted Dec 16, 2025

Inter-prediction concept using tile-independency constraints

Inventors: Robert Skupin (Berlin, DE); Yago Sánchez De La Fuente (Berlin, DE); Cornelius Hellge (Berlin, DE); Adam Wieckowski (Berlin, DE); Valeri George (Berlin, DE); Benjamin Bross (Berlin, DE); Thomas Schierl (Berlin, DE); Karsten Suehring (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
H04N19/159H04N19/105H04N19/139H04N19/176H04N19/196H04N19/577
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,501,053
App. No.
17/328,866
Granted
Dec 16, 2025
Kind
B2
Abstract

Different concepts for improving video coding efficiency are described, many of them allow for video coding in a manner realizing tile-independent coding with reducing, however, the coding efficiency losses otherwise associated with the tile-dependency disruptions, with nevertheless merely marginally, if all, modifying the codec behavior alongside the tile boundaries.

Claims (41)

1 . A video decoder comprising at least one processor configured to:

identify a location of a current block within a current picture, wherein the current picture is one of a sequence of pictures in temporal presentation order;

derive motion information for the current block by adding a temporal motion vector, MVTemp, to the location of the current block within the picture;

determine that the motion information extends beyond a boundary of an independently coded spatial region within a reference picture, the reference picture preceding the current picture in the temporal presentation order;

in response to the determination, clip the motion information;

identify a location of a co-located block within the reference picture based on the clipped motion information, wherein the co-located block is within the independently coded spatial region of the reference picture;

determine a motion vector for the co-located block in the reference picture; and

predict the current block based on the motion vector from the co-located block.

2 . The video decoder of claim 1 , wherein the at least one processor is further configured to scale the motion vector from the co-located block according to temporal differences of involved pictures.

3 . The video decoder of claim 1 , wherein the motion information is clipped to be within CTU boundaries of the current block.

4 . The video decoder of claim 1 , wherein the at least one processor is further configured to decode a reference picture index for the reference picture from a data stream.

5 . The video decoder of claim 1 , wherein the at least one processor is further configured to decode a motion vector prediction residual from a data stream.

6 . The video decoder of claim 1 , wherein the independently coded spatial region is a tile.

7 . The video decoder of claim 1 , wherein the at least one processor is further configured to select the predicted a motion vector as a selected candidate from a motion vector candidate list based on an index from a data stream.

8 . The video decoder of claim 7 , wherein the at least one processor is further configured to add a motion vector prediction residual from the data stream to the selected candidate to produce a motion vector for the current block.

9 . A method for video decoding, the method comprising:

identifying a location of a current block within a current picture, wherein the current picture is one of a sequence of pictures in temporal presentation order;

deriving motion information for the current block by adding a temporal motion vector, MVTemp, to the location of the current block within the picture;

determining that the motion information extends beyond a boundary of an independently coded spatial region within a reference picture, the reference picture preceding the current picture in the temporal presentation order;

in response to the determination, clipping the motion information;

identifying a location of a co-located block within the reference picture based on the clipped motion information, wherein the co-located block is within the independently coded spatial region of the reference picture;

determining a motion vector for the co-located block in the reference picture; and

predicting the current block by based on the motion vector from the co-located block.

10 . The method of claim 9 , further comprising scaling the motion vector from the co-located block according to temporal differences of involved pictures.

11 . The method of claim 9 , wherein the motion information is clipped to be within CTU boundaries of the current block.

12 . The method of claim 9 , further comprising decoding a reference picture index for the reference picture from a data stream.

13 . The method of claim 9 , further comprising decoding a motion vector prediction residual from a data stream.

14 . The method of claim 9 , wherein the independently coded spatial region is a tile.

15 . The method of claim 9 , further comprising selecting a motion vector as a selected candidate from a motion vector candidate list based on an index from a data stream.

16 . The method of claim 15 , further comprising adding a motion vector prediction residual from the data stream to the selected candidate to produce a motion vector for the current block.

17 . A non-transitory digital storage medium having computer program instructions stored thereon, that when executed causes at least one processor to:

identify a location of a current block within a current picture, wherein the current picture is one of a sequence of pictures in temporal presentation order;

derive motion information for the current block by adding a temporal motion vector, MVTemp, to the location of the current block within the picture;

determine that the motion information extends beyond a boundary of an independently coded spatial region within a reference picture, the reference picture preceding the current picture in the temporal presentation order;

in response to the determination, clip the motion information;

identify a location of a co-located block within the reference picture based on the clipped motion information, wherein the co-located block is within the independently coded spatial region of the reference picture;

determine a motion vector for the co-located block in the reference picture; and

predicting the current block based on the motion vector from the co-located block.

18 . The non-transitory digital storage medium of claim 17 , further comprising instructions that when executed cause the at least one processor to scale the motion vector from the co-located block according to temporal differences of involved pictures.

19 . The non-transitory digital storage medium of claim 17 , wherein the motion information is clipped to be within CTU boundaries of the current block.

20 . The non-transitory digital storage medium of claim 17 , further comprising instructions that when executed cause the at least one processor to decode a reference picture index for the reference picture from a data stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2021
From: SKUPIN, ROBERT; SÁNCHEZ DE LA FUENTE, YAGO; HELLGE, CORNELIUS; WIECKOWSKI, ADAM; GEORGE, VALERI; BROSS, BENJAMIN; SCHIERL, THOMAS; SUEHRING, KARSTEN; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 057311/0301 →
Priority Claims (1)
EP 18208418 · Nov 26, 2018 · regional
Continuity (2)
Continuation PCTEP2019082435 · Nov 25, 2019
Related Publication 20210281855A1 · Sep 9, 2021
References Cited (21)
US 20070286282A1 · Haskell · 2007 [cited by examiner]
US 20080008241A1 · Park · 2008 [cited by examiner]
US 20120195368A1 · Chien · 2012 [cited by examiner]
US 20130016785A1 · Wang · 2013 [cited by examiner]
US 20130343461A1 · Lee et al. · 2013 [cited by applicant]
US 20140119671A1 · Lim et al. · 2014 [cited by applicant]
US 20140301464A1 · Wu · 2014 [cited by applicant]
US 20160057441A1 · Skupin · 2016 [cited by examiner]
US 20180098063A1 · Chen et al. · 2018 [cited by applicant]
US 20200177911A1 · Aono · 2020 [cited by applicant]
JP 2014520477 · 2014 [cited by applicant]
JP 2016519516 · 2016 [cited by applicant]
JP 2017126272 · 2017 [cited by applicant]
JP 2020145484 · 2020 [cited by applicant]
KR 1020140057238 · 2014 [cited by applicant]
KR 1020180018388 · 2018 [cited by applicant]
Bross, B., et al., “Suggested fix for MCTS SEI message”, 27. JCT-VC Meeting; Mar. 31, 2017-Jul. 4, 2017; Hobart; (Joint Collaborative Team on Video Coding of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16); URL: http://wftp3.it… [cited by applicant]
Notice of Reasons for Rejection, dated Oct. 4, 2022, Japanese patent application 2021-529678. [cited by applicant]
JVET-K0104-v5, Li Zhang et al., CE4-related: History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting, Jul. 10-18, 2018, 7 pp. [cited by applicant]
JVET-J0026r1, Kiran Misra et al., “Description of SDR and HDR Video Coding Technology Proposal by Sharp and Foxconn,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting, … [cited by applicant]
JVET-K0189-v2, Huanbang Chen et al., Non-CE4: ATMVP Simplification, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting, Jul. 10-18, 2018, 4 pp. [cited by applicant]