IP Library › Granted Patent US 12,348,761
Granted Patent B2
US 12,348,761 · App. 17/831,074 · Granted Jul 1, 2025

Merge with motion vector differencing in affine mode

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/517H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,761
App. No.
17/831,074
Granted
Jul 1, 2025
Kind
B2
Abstract

A method of visual media processing, includes: performing a conversion between a current video block of a visual media data and a bitstream representation of the visual media data according to a modification rule, wherein the current video block is coded using affine motion information; wherein the modification rule specifies to modify an affine motion information coded in the bitstream representation using motion vector differences and/or reference picture indices during decoding.

Claims (34)

1. A method of visual media processing, comprising:

determining, for a conversion between a current video block of visual media data and a bitstream of the visual media data, that an affine candidate for the current video block is subject to a modification based on a modification rule; and

performing the conversion based on the determining,

wherein the modification rule specifies to modify one or more control point motion vectors associated with the current video block;

wherein modifying the one or more control point motion vectors of the affine candidate for the current video block includes adding one or more offset values to the one or more control point motion vectors, wherein each of the one or more offset values is derived by using a direction index and a distance index associated with a control point motion vector; and

wherein when an affine model of the current video block is a 6-parameter model defined using three control point motion vectors MV0, MV1 and MV2, only two control point motion vectors are to be modified, and the only two control point motion vectors to be modified are MV0 and MV1.

2. The method of claim 1 , wherein the direction index and the distance index are included in the bitstream.

3. The method of claim 1 , wherein when the affine model of the current video block is a 4-parameter model defined using two control point motion vectors MV0 and MV1, the one or more control point motion vectors to be modified are MV0 and MV1.

4. The method of claim 1 , wherein whether to modify the one or more control point motion vectors is indicated using a syntax element in the bitstream.

5. The method of claim 4 , wherein the syntax element is context coded.

6. The method of claim 1 , wherein the modified control point motion vectors are stored for processing other video blocks of the visual media data.

7. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

8. The method of claim 1 , wherein the conversion includes decoding the bitstream to generate the current video block.

9. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current video block of visual media data and a bitstream of the visual media data, that an affine candidate for the current video block is subject to a modification based on a modification rule; and

perform the conversion based on the determining,

wherein the modification rule specifies to modify one or more control point motion vectors associated with the current video block;

wherein modifying the one or more control point motion vectors of the affine candidate for the current video block includes adding one or more offset values to the one or more control point motion vectors, wherein each of the one or more offset values is derived by using a direction index and a distance index associated with a control point motion vector; and

wherein when an affine model of the current video block is a 6-parameter model defined using three control point motion vectors MV0, MV1 and MV2, only two control point motion vectors are to be modified, and the one or more only two control point motion vectors to be modified are MV0 and MV1.

10. The apparatus of claim 9 , wherein the direction index and the distance index are included in the bitstream.

11. The apparatus of claim 9 , wherein when the affine model of the current video block is a 4-parameter model defined using two control point motion vectors MV0 and MV1, the one or more control point motion vectors to be modified are MV0 and MV1.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current video block of visual media data and a bitstream of the visual media data, that an affine candidate for the current video block is subject to a modification based on a modification rule; and

perform the conversion based on the determining,

wherein the modification rule specifies to modify one or more control point motion vectors associated with the current video block;

wherein modifying the one or more control point motion vectors of the affine candidate for the current video block includes adding one or more offset values to the one or more control point motion vectors, wherein each of the one or more offset values is derived by using a direction index and a distance index associated with a control point motion vector; and

wherein when an affine model of the current video block is a 6-parameter model defined using three control point motion vectors MV0, MV1 and MV2, only two control point motion vectors are to be modified, and the only two control point motion vectors to be modified are MV0 and MV1.

13. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current video block of visual media data, that an affine candidate for the current video block is subject to a modification based on a modification rule; and

generating the bitstream based on the determining,

wherein the modification rule specifies to modify one or more control point motion vectors associated with the current video block;

wherein modifying the one or more control point motion vectors of the affine candidate for the current video block includes adding one or more offset values to the one or more control point motion vectors, wherein each of the one or more offset values is derived by using a direction index and a distance index associated with a control point motion vector; and

wherein when an affine model of the current video block is a 6-parameter model defined using three control point motion vectors MV0, MV1 and MV2, only two control point motion vectors are to be modified, and the only two control point motion vectors to be modified are MV0 and MV1.

14. The apparatus of claim 9 , wherein whether to modify the one or more control point motion vectors is indicated using a syntax element in the bitstream.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 060090/0706 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060090/0785 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: LIU, HONGBIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060090/0915 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060090/0972 →
Priority Claims (1)
WO PCT/CN2019/122347 · Dec 2, 2019 · international
Continuity (2)
Continuation PCTCN2020133271 · Dec 2, 2020
Related Publication 20220303571A1 · Sep 22, 2022
References Cited (400)
US 6047112A · Wise et al. · 2000 [cited by applicant]
US 8988531B2 · Zhou · 2015 [cited by applicant]
US 9525861B2 · Zhang et al. · 2016 [cited by applicant]
US 9554133B2 · Ye et al. · 2017 [cited by applicant]
US 9584819B2 · Wang et al. · 2017 [cited by applicant]
US 9743066B2 · Zhang et al. · 2017 [cited by applicant]
US 9912966B2 · Hannuksela · 2018 [cited by applicant]
US 9924168B2 · Zhang et al. · 2018 [cited by applicant]
US 9998757B2 · Chen et al. · 2018 [cited by applicant]
US 10057594B2 · Xiu et al. · 2018 [cited by applicant]
US 10097846B2 · Deshpande · 2018 [cited by applicant]
US 10165252B2 · An et al. · 2018 [cited by applicant]
US 10200709B2 · Chen et al. · 2019 [cited by applicant]
US 10205968B2 · Liu et al. · 2019 [cited by applicant]
US 10455231B2 · Xu et al. · 2019 [cited by applicant]
US 10483493B2 · Sargent et al. · 2019 [cited by applicant]
US 10523964B2 · Chuang et al. · 2019 [cited by applicant]
US 10523967B2 · Lee et al. · 2019 [cited by applicant]
US 10567804B2 · Chen et al. · 2020 [cited by applicant]
US 10587859B2 · An et al. · 2020 [cited by applicant]
US 10757417B2 · Zhang et al. · 2020 [cited by applicant]
US 10798385B2 · Lee et al. · 2020 [cited by applicant]
US 10805639B2 · Lee et al. · 2020 [cited by applicant]
US 10819891B2 · Wang et al. · 2020 [cited by applicant]
US 10841609B1 · Liu et al. · 2020 [cited by applicant]
US 10880547B2 · Xu et al. · 2020 [cited by applicant]
US 10904565B2 · Chuang et al. · 2021 [cited by applicant]
US 11095898B2 · Lim et al. · 2021 [cited by applicant]
US 11095917B2 · Zhang et al. · 2021 [cited by applicant]
US 11109061B2 · Chen et al. · 2021 [cited by applicant]
US 11128884B2 · Liu et al. · 2021 [cited by applicant]
US 11146810B2 · Chen et al. · 2021 [cited by applicant]
US 11212523B2 · Chiu et al. · 2021 [cited by applicant]
US 11343529B2 · Zhang et al. · 2022 [cited by applicant]
US 11343533B2 · Esenlik et al. · 2022 [cited by applicant]
US 11470309B2 · Zhang et al. · 2022 [cited by applicant]
US 11496733B2 · Zhang et al. · 2022 [cited by applicant]
US 11523108B2 · Zhang et al. · 2022 [cited by applicant]
US 11523109B2 · Li et al. · 2022 [cited by applicant]
US 11533513B2 · Zhang et al. · 2022 [cited by applicant]
US 11539950B2 · Zhang et al. · 2022 [cited by applicant]
US 11546593B2 · Zhang et al. · 2023 [cited by applicant]
US 11553177B2 · Zhang et al. · 2023 [cited by applicant]
US 11627313B2 · Zhang et al. · 2023 [cited by applicant]
US 11956432B2 · Zhang et al. · 2024 [cited by applicant]
US 11962771B2 · Zhang et al. · 2024 [cited by applicant]
US 12047558B2 · Zhang et al. · 2024 [cited by applicant]
US 12075030B2 · Zhang et al. · 2024 [cited by applicant]
US 12192459B2 · Zhang et al. · 2025 [cited by applicant]
US 20040008766A1 · Wang et al. · 2004 [cited by applicant]
US 20040177383A1 · Martinolich et al. · 2004 [cited by applicant]
US 20050019006A1 · Suh et al. · 2005 [cited by applicant]
US 20070086521A1 · Wang et al. · 2007 [cited by applicant]
US 20080204472A1 · Maertens et al. · 2008 [cited by applicant]
US 20080267297A1 · Sampedro et al. · 2008 [cited by applicant]
US 20080273597A1 · Kovalenko et al. · 2008 [cited by applicant]
US 20100086052A1 · Park et al. · 2010 [cited by applicant]
US 20120294353A1 · Fu et al. · 2012 [cited by applicant]
US 20130089145A1 · Guo et al. · 2013 [cited by applicant]
US 20130101018A1 · Chong et al. · 2013 [cited by applicant]
US 20130101035A1 · Wang et al. · 2013 [cited by applicant]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20130182774A1 · Wang et al. · 2013 [cited by applicant]
US 20130202051A1 · Zhou et al. · 2013 [cited by applicant]
US 20130266075A1 · Wang et al. · 2013 [cited by applicant]
US 20130294524A1 · Van Der Auwera et al. · 2013 [cited by applicant]
US 20130322531A1 · Chen et al. · 2013 [cited by applicant]
US 20130336406A1 · Zhang et al. · 2013 [cited by applicant]
US 20140003492A1 · Chen et al. · 2014 [cited by applicant]
US 20140003504A1 · Ugur et al. · 2014 [cited by applicant]
US 20140003535A1 · Haque et al. · 2014 [cited by applicant]
US 20140146869A1 · Zhang · 2014 [cited by applicant]
US 20140185682A1 · Chen et al. · 2014 [cited by applicant]
US 20140192892A1 · Van Der Auwera et al. · 2014 [cited by applicant]
US 20140198844A1 · Hsu et al. · 2014 [cited by applicant]
US 20140218473A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140301441A1 · Wang et al. · 2014 [cited by applicant]
US 20140301476A1 · Deshpande · 2014 [cited by applicant]
US 20150010050A1 · Chen et al. · 2015 [cited by applicant]
US 20150010091A1 · Hsu et al. · 2015 [cited by applicant]
US 20150103924A1 · Misra et al. · 2015 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150215631A1 · Zhou et al. · 2015 [cited by applicant]
US 20150271515A1 · Pang et al. · 2015 [cited by applicant]
US 20150341655A1 · Joshi et al. · 2015 [cited by applicant]
US 20150341664A1 · Zhang et al. · 2015 [cited by applicant]
US 20160100189A1 · Pang et al. · 2016 [cited by applicant]
US 20160100196A1 · Wu et al. · 2016 [cited by applicant]
US 20160105690A1 · Denoual et al. · 2016 [cited by applicant]
US 20160165248A1 · Lainema et al. · 2016 [cited by applicant]
US 20160173887A1 · Deshpande · 2016 [cited by applicant]
US 20160219278A1 · Chen et al. · 2016 [cited by applicant]
US 20160234522A1 · Lu et al. · 2016 [cited by applicant]
US 20160316215A1 · Minoo et al. · 2016 [cited by applicant]
US 20160337661A1 · Pang et al. · 2016 [cited by applicant]
US 20160381385A1 · Ugur · 2016 [cited by applicant]
US 20170006302A1 · Lee et al. · 2017 [cited by applicant]
US 20170006304A1 · Miyoshi · 2017 [cited by applicant]
US 20170064339A1 · Van Der Auwera et al. · 2017 [cited by applicant]
US 20170237999A1 · Hendry et al. · 2017 [cited by applicant]
US 20170272758A1 · Lin et al. · 2017 [cited by applicant]
US 20170289566A1 · He et al. · 2017 [cited by applicant]
US 20170295369A1 · Nakagami · 2017 [cited by applicant]
US 20170302951A1 · Joshi et al. · 2017 [cited by applicant]
US 20170332095A1 · Zou et al. · 2017 [cited by applicant]
US 20180048909A1 · Liu et al. · 2018 [cited by applicant]
US 20180091829A1 · Liu et al. · 2018 [cited by applicant]
US 20180098063A1 · Chen et al. · 2018 [cited by applicant]
US 20180098090A1 · Lin et al. · 2018 [cited by applicant]
US 20180184083A1 · Panusopone et al. · 2018 [cited by applicant]
US 20180192072A1 · Chen et al. · 2018 [cited by applicant]
US 20180199057A1 · Chuang et al. · 2018 [cited by applicant]
US 20180270500A1 · Li et al. · 2018 [cited by applicant]
US 20180310017A1 · Chen et al. · 2018 [cited by applicant]
US 20180343463A1 · Xiu et al. · 2018 [cited by applicant]
US 20180376126A1 · Hannuksela · 2018 [cited by applicant]
US 20190058884A1 · Zhou · 2019 [cited by applicant]
US 20190058896A1 · Huang et al. · 2019 [cited by applicant]
US 20190082191A1 · Chuang et al. · 2019 [cited by applicant]
US 20190104319A1 · Zhang et al. · 2019 [cited by applicant]
US 20190110064A1 · Zhang et al. · 2019 [cited by applicant]
US 20190116376A1 · Chen et al. · 2019 [cited by applicant]
US 20190138889A1 · Jiang et al. · 2019 [cited by applicant]
US 20190141320A1 · Wang et al. · 2019 [cited by applicant]
US 20190149838A1 · Zhang et al. · 2019 [cited by applicant]
US 20190158865A1 · Park et al. · 2019 [cited by applicant]
US 20190208234A1 · Van Brandenburg · 2019 [cited by applicant]
US 20190246143A1 · Zhang et al. · 2019 [cited by applicant]
US 20190273937A1 · Yu et al. · 2019 [cited by applicant]
US 20200112733A1 · Li · 2020 [cited by examiner]
US 20200221117A1 · Liu et al. · 2020 [cited by applicant]
US 20200221122A1 · Ye et al. · 2020 [cited by applicant]
US 20200228827A1 · Hannuksela · 2020 [cited by applicant]
US 20200252619A1 · Zhang et al. · 2020 [cited by applicant]
US 20200296405A1 · Huang et al. · 2020 [cited by applicant]
US 20200304805A1 · Li et al. · 2020 [cited by applicant]
US 20200329246A1 · Yu et al. · 2020 [cited by applicant]
US 20200382795A1 · Zhang et al. · 2020 [cited by applicant]
US 20200396453A1 · Zhang et al. · 2020 [cited by applicant]
US 20210029351A1 · Zhang et al. · 2021 [cited by applicant]
US 20210029362A1 · Liu et al. · 2021 [cited by applicant]
US 20210029378A1 · He et al. · 2021 [cited by applicant]
US 20210044818A1 · Furht et al. · 2021 [cited by applicant]
US 20210044838A1 · Chen et al. · 2021 [cited by applicant]
US 20210058637A1 · Zhang et al. · 2021 [cited by applicant]
US 20210076029A1 · Han et al. · 2021 [cited by applicant]
US 20210076050A1 · Zhang et al. · 2021 [cited by applicant]
US 20210084295A1 · Chen et al. · 2021 [cited by applicant]
US 20210084340A1 · Li et al. · 2021 [cited by applicant]
US 20210092393A1 · Chao et al. · 2021 [cited by applicant]
US 20210136363A1 · Jang · 2021 [cited by applicant]
US 20210136407A1 · Aono et al. · 2021 [cited by applicant]
US 20210136422A1 · Huang et al. · 2021 [cited by applicant]
US 20210185347A1 · Liu et al. · 2021 [cited by applicant]
US 20210195177A1 · Zhang et al. · 2021 [cited by applicant]
US 20210211707A1 · Liu et al. · 2021 [cited by applicant]
US 20210211713A1 · Zhang et al. · 2021 [cited by applicant]
US 20210211714A1 · Zhang et al. · 2021 [cited by applicant]
US 20210219001A1 · Jang · 2021 [cited by applicant]
US 20210227250A1 · Liu et al. · 2021 [cited by applicant]
US 20210235109A1 · Liu et al. · 2021 [cited by applicant]
US 20210243467A1 · Zhang et al. · 2021 [cited by applicant]
US 20210243468A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266530A1 · Liu et al. · 2021 [cited by applicant]
US 20210266560A1 · Jang · 2021 [cited by applicant]
US 20210266577A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266584A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266585A1 · Liu et al. · 2021 [cited by applicant]
US 20210266591A1 · Zhang et al. · 2021 [cited by applicant]
US 20210274208A1 · Zhang et al. · 2021 [cited by applicant]
US 20210274209A1 · He et al. · 2021 [cited by applicant]
US 20210274213A1 · Xiu et al. · 2021 [cited by applicant]
US 20210281865A1 · Liu et al. · 2021 [cited by applicant]
US 20210281875A1 · Liu et al. · 2021 [cited by applicant]
US 20210289209A1 · Lee · 2021 [cited by examiner]
US 20210337184A1 · Meng et al. · 2021 [cited by applicant]
US 20210337228A1 · Wang et al. · 2021 [cited by applicant]
US 20210352302A1 · Zhang et al. · 2021 [cited by applicant]
US 20210352315A1 · Zhang et al. · 2021 [cited by applicant]
US 20210368198A1 · Zhang et al. · 2021 [cited by applicant]
US 20210368199A1 · Zhang et al. · 2021 [cited by applicant]
US 20210368203A1 · Zhang et al. · 2021 [cited by applicant]
US 20210385481A1 · Liu et al. · 2021 [cited by applicant]
US 20210385482A1 · Liu et al. · 2021 [cited by applicant]
US 20210392367A1 · Zhang et al. · 2021 [cited by applicant]
US 20210409730A1 · Wang et al. · 2021 [cited by applicant]
US 20220007048A1 · He et al. · 2022 [cited by applicant]
US 20220014735A1 · Chen et al. · 2022 [cited by applicant]
US 20220053207A1 · Deshpande · 2022 [cited by applicant]
US 20220060695A1 · Zhang et al. · 2022 [cited by applicant]
US 20220060696A1 · Zhang et al. · 2022 [cited by applicant]
US 20220060718A1 · Zhang et al. · 2022 [cited by applicant]
US 20220070442A1 · Jang · 2022 [cited by applicant]
US 20220094909A1 · Hannuksela et al. · 2022 [cited by applicant]
US 20220132148A1 · Wang et al. · 2022 [cited by applicant]
US 20220159246A1 · Zhang et al. · 2022 [cited by applicant]
US 20220166971A1 · Zhang et al. · 2022 [cited by applicant]
US 20220166985A1 · Zhang et al. · 2022 [cited by applicant]
US 20220174322A1 · Zhang et al. · 2022 [cited by applicant]
US 20220217342A1 · Hannuksela et al. · 2022 [cited by applicant]
US 20220239912A1 · Zhang et al. · 2022 [cited by applicant]
US 20220239926A1 · Jhu et al. · 2022 [cited by applicant]
US 20220248007A1 · Misra et al. · 2022 [cited by applicant]
US 20220256146A1 · Zhang et al. · 2022 [cited by applicant]
US 20220256148A1 · Zhang et al. · 2022 [cited by applicant]
US 20220256195A1 · Zhang et al. · 2022 [cited by applicant]
US 20220272332A1 · Lai et al. · 2022 [cited by applicant]
US 20220272378A1 · Samuelsson et al. · 2022 [cited by applicant]
US 20220394301A1 · Deshpande et al. · 2022 [cited by applicant]
AU 2016273973A1 · 2018 [cited by applicant]
CN 1593065A · 2005 [cited by applicant]
CN 1609957A · 2005 [cited by applicant]
CN 1750659A · 2006 [cited by applicant]
CN 101668219A · 2010 [cited by applicant]
CN 101990103A · 2011 [cited by applicant]
CN 103202016A · 2013 [cited by applicant]
CN 103891292A · 2014 [cited by applicant]
CN 103891293A · 2014 [cited by applicant]
CN 103975596A · 2014 [cited by applicant]
CN 104041033A · 2014 [cited by applicant]
CN 104054347A · 2014 [cited by applicant]
CN 104641648A · 2015 [cited by applicant]
CN 104662914A · 2015 [cited by applicant]
CN 104702963A · 2015 [cited by applicant]
CN 104756495A · 2015 [cited by applicant]
CN 104823449A · 2015 [cited by applicant]
CN 104885464A · 2015 [cited by applicant]
CN 105009587A · 2015 [cited by applicant]
CN 105027567A · 2015 [cited by applicant]
CN 105074819A · 2015 [cited by applicant]
CN 105144720A · 2015 [cited by applicant]
CN 105393536A · 2016 [cited by applicant]
CN 105531999A · 2016 [cited by applicant]
CN 105556975A · 2016 [cited by applicant]
CN 105684448A · 2016 [cited by applicant]
CN 106165419A · 2016 [cited by applicant]
CN 106303543A · 2017 [cited by applicant]
CN 106464893A · 2017 [cited by applicant]
CN 106537915A · 2017 [cited by applicant]
CN 106664424A · 2017 [cited by applicant]
CN 106797229A · 2017 [cited by applicant]
CN 106797476A · 2017 [cited by applicant]
CN 107105295A · 2017 [cited by applicant]
CN 107211156A · 2017 [cited by applicant]
CN 107801039A · 2018 [cited by applicant]
CN 107852490A · 2018 [cited by applicant]
CN 108028929A · 2018 [cited by applicant]
CN 108432250A · 2018 [cited by applicant]
CN 108781284A · 2018 [cited by applicant]
CN 108781294A · 2018 [cited by applicant]
CN 108965871A · 2018 [cited by applicant]
CN 109076214A · 2018 [cited by applicant]
CN 109076216A · 2018 [cited by applicant]
CN 109076218A · 2018 [cited by applicant]
CN 109076236A · 2018 [cited by applicant]
CN 109155855A · 2019 [cited by applicant]
CN 109600611A · 2019 [cited by applicant]
CN 109691102A · 2019 [cited by applicant]
CN 109792531A · 2019 [cited by applicant]
CN 109792533A · 2019 [cited by applicant]
CN 109996072A · 2019 [cited by applicant]
CN 110097889A · 2019 [cited by applicant]
CN 110140355A · 2019 [cited by applicant]
CN 110572658A · 2019 [cited by applicant]
CN 110662036A · 2020 [cited by applicant]
CN 110677678A · 2020 [cited by applicant]
CN 114631317B · 2024 [cited by applicant]
CN 114208166B · 2024 [cited by applicant]
CN 114631321B · 2024 [cited by applicant]
CN 114270831B · 2024 [cited by applicant]
CN 114503577B · 2024 [cited by applicant]
CN 114556952B · 2024 [cited by applicant]
EP 1672930A3 · 2010 [cited by applicant]
EP 2941891A1 · 2015 [cited by applicant]
EP 2870761B1 · 2018 [cited by applicant]
EP 3468190A1 · 2019 [cited by applicant]
EP 3942823A1 · 2022 [cited by applicant]
GB 201815444 · 2018 [cited by applicant]
GB 201902829 · 2019 [cited by applicant]
GB 201908535 · 2019 [cited by applicant]
GB 201911952 · 2019 [cited by applicant]
IN 544863 · 2024 [cited by applicant]
IN 554139 · 2024 [cited by applicant]
IN 557704 · 2025 [cited by applicant]
JP 2015015575A · 2015 [cited by applicant]
JP 2017520162A · 2017 [cited by applicant]
JP 2017522839A · 2017 [cited by applicant]
JP 6280679B2 · 2018 [cited by applicant]
JP 2020017970A · 2020 [cited by applicant]
JP 2022552537A · 2022 [cited by applicant]
JP 7372443B1 · 2023 [cited by applicant]
JP 7454681B2 · 2024 [cited by applicant]
JP 7571218B2 · 2024 [cited by applicant]
JP 7575475B2 · 2024 [cited by applicant]
JP 7583126B2 · 2024 [cited by applicant]
KR 20140056342A · 2014 [cited by applicant]
KR 1020150057591A · 2015 [cited by applicant]
KR 20170018819A · 2017 [cited by applicant]
KR 20180128955A · 2018 [cited by applicant]
KR 20180129584A · 2018 [cited by applicant]
KR 20200126813A · 2020 [cited by applicant]
KR 102701594B1 · 2024 [cited by applicant]
MX 418306 · 2024 [cited by applicant]
RU 2686559C2 · 2019 [cited by applicant]
RU 2820844C2 · 2024 [cited by applicant]
WO 2014049980A1 · 2014 [cited by applicant]
WO 2014106692A1 · 2014 [cited by applicant]
WO 2015008477A1 · 2015 [cited by applicant]
WO 2015008479A1 · 2015 [cited by applicant]
WO 2015011339A1 · 2015 [cited by applicant]
WO 2015038877A1 · 2015 [cited by applicant]
WO 2015056941A1 · 2015 [cited by applicant]
WO 2015142556A2 · 2015 [cited by applicant]
WO 2016100424A1 · 2016 [cited by applicant]
WO 2016120468A1 · 2016 [cited by applicant]
WO 2016127889A1 · 2016 [cited by applicant]
WO 2016208241A1 · 2016 [cited by applicant]
WO 2017083784A1 · 2017 [cited by applicant]
WO 2017137444A1 · 2017 [cited by applicant]
WO 2017157259A1 · 2017 [cited by applicant]
WO 2018001208A1 · 2018 [cited by applicant]
WO 2018099269A1 · 2018 [cited by applicant]
WO 2018113658A1 · 2018 [cited by applicant]
WO 2019004283A1 · 2019 [cited by applicant]
WO 2019008174A1 · 2019 [cited by applicant]
WO 2019010156A1 · 2019 [cited by applicant]
WO 2019073112A1 · 2019 [cited by applicant]
WO 2019078169A1 · 2019 [cited by applicant]
WO 2019132577A1 · 2019 [cited by applicant]
WO 2019145262A1 · 2019 [cited by applicant]
WO 2019194507A1 · 2019 [cited by applicant]
WO 2019194568A1 · 2019 [cited by applicant]
WO 2019222060A1 · 2019 [cited by applicant]
WO 2020003273A1 · 2020 [cited by applicant]
WO 2020146582A1 · 2020 [cited by applicant]
WO 2020222588A1 · 2020 [cited by applicant]
WO 2021049586A1 · 2021 [cited by applicant]
WO 2021052794A1 · 2021 [cited by applicant]
Chen et al. “CE4: Affine Merge Enhancement with Simplification (Test 4.2.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVET-L03… [cited by applicant]
Li et al. “AHG12: Modification for Subpicture,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P0171, 2019. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/861,728 dated Apr. 20, 2023. [cited by applicant]
Liu et al. “CE2: Adaptive Motion Vector Resolution for Affine Inter Mode (Test 2.1.2),” Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 1113th Meeting: Marrakech, MA, Jan. 9-18, 2019. docum… [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 3),” oint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC ITC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVET-L1001, 2018. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M1001, 2019. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 5),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, document JVET-N1001, 2019. [cited by applicant]
Chen et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of TU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017, document JV… [cited by applicant]
Chen et al. “Crosscheck of JVET-L0142 (CE4: Simplification of the Common Base for Affine Merge (Test 4.2.6).” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oc… [cited by applicant]
Han et al. “CE4.1.3: Affine Motion Compensation Prediction,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, document JVET-K0337, 2018. [cited by applicant]
Huang et al. “CE4.2.5: Simplification of Affine Merge List Construction and Move ATMVP to Affine Merge List,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oc… [cited by applicant]
“High Efficiency Video Coding,” Series H: Audiovisual and Multimedia Systems: Infrastructure of Audiovisual Services—Coding of Moving Video, ITU-T Telecommunication Standardization Sector of ITU, H.265, Feb. 2018. [cited by applicant]
Lai et al. “CE4.3.4: Removal of AMVR Flag Constraint,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, document JVET-K0247, 2018. [cited by applicant]
Laroche et al. “CE2: On Subblock Merge Index Coding (Test CE2.2.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M0381, 2… [cited by applicant]
Lee et al. “CE4: Simplification of the Common Base for Affine Merge (Test 4.2.6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macau, CN, Oct. 8-12, 2018, document JVE… [cited by applicant]
Lee et al. “Cross-check of JCTVC-L0279 on Motion Data Compression,” Joint Collaborative Team on Video Coding JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Geneva, CH, Jan. 14-23, 2013, document… [cited by applicant]
Lee et al. “CE2-related: Simplification of Subblock-Based Temporal Merging Candidates,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, doc… [cited by applicant]
Li, Guichun. “Crosscheck of JVET-N0236 (CE2-Related: Prediction Refinement with Optical Flow for Affine Mode),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH,… [cited by applicant]
Liao et al. “CE10.3.1.b: Triangular Prediction Unit Mode,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVET-L0124, 2018. [cited by applicant]
Liu et al. “CE4-related: Adaptive Motion Vector Resolution for Affine Inter Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, document JVE… [cited by applicant]
Luo et al. “CE2-Related: Prediction Refinement with Optical Flow for Affine Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, document J… [cited by applicant]
Rosewarne et al. “High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) Improved Encoder Description Update 7,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 25th Mee… [cited by applicant]
Zhang et al. “CE2-Related: Early Awareness of Accessing Temporal Blocks in Sub-Block Merge List Construction,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, M… [cited by applicant]
Extended European Search Report from European Patent Application No. 20810559.3 dated May 19, 2022 (7 pages). [cited by applicant]
Extended European Search Report from European Patent Application No. 20809576.0 dated May 19, 2022 (7 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/091537 dated Jul. 29, 2020 (8 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/091538 dated Aug. 19, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/091539 dated Aug. 21, 2020 (9 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/091540 dated Jul. 30, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/133271 dated Mar. 8, 2021 (10 pages). [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/521,012 dated Jan. 24, 2022. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/521,043 dated Feb. 4, 2022. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/520,975 dated Mar. 3, 2022. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/521,012 dated May 6, 2022. [cited by applicant]
Chen et al. “Algorithm Description for Versatile Video Coding and Test Model 0 (VTM 9),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting, by teleconference, Apr. 15-24, 20… [cited by applicant]
Choi et al. “AHG8: Region-Wise Scalability Support with Reference Picture Resampling,” Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 1115th Meeting: Gothenburg, SE, Jul. 3-12, 2019, docum… [cited by applicant]
Li et al. “CE2: Memory Bandwidth Reduction for the Affine Mode (Test 2.4.3),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, docuent JVET-N0… [cited by applicant]
Li et al. “Non-CE4: Adaptive Subblock Size for Affine Motion Compensation,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-… [cited by applicant]
Liu et al. “CE2-related: Joint Test of AMVR for Affine Inter Mode (Test 2.1.1 and Test 2.1.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2… [cited by applicant]
Xu et al., “Overview of the Emerging HEVC Screen Content Coding Extension”, IEEE Transactions on Circuits and Systems for Video Technology, Jan. 2016, 26(1):50-62. [cited by applicant]
Alshin et al. “Bi-Directional Optical Flow for Improving Motion Compensation,” Dec. 8-10, 2010, 28th Picture Coding Symposium, PCS2010, Nagoya, Japan, pp. 422-425. [cited by applicant]
Boyce, Jill, “AHG15: On Interoperability Point Signalling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, document JVET-N0276, 2019. [cited by applicant]
Boyce et al. “Sub-Pictures and Sub-Picture Sets with Level Derivation,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-O055… [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-O2001, 2019. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P2001, 2019. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 7-17, 2020, document JVET-Q2001 vD vE, 2020. [cited by applicant]
Chen et al. “AHG17: [SYS-VVC] Signalling Subpicture Coded Video Sequence,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, Switzerland, Mar. 19-27, 2019, document … [cited by applicant]
Chen et al. “AHG8: Adaptive Resolution Change,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-O0303, 2019. [cited by applicant]
Chen et al. “AHG8: Integrated Specification Text for Reference Picture Resampling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, docume… [cited by applicant]
Chen et al. “Algorithm Description for Versatile Video Coding and Test Model 6 (VTM 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, d… [cited by applicant]
Chen et al. “AHG17/AHG12: On Signalling the Subpicture IDs,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P0141, 2019. [cited by applicant]
Chen et al. “AHG17/AHG12: On Signalling of Subpicture Structure in the SPS,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P01… [cited by applicant]
Chen et al. “AHG17/AHG12: On Associating Slices with a Subpicture,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P0144, 2019. [cited by applicant]
Chen et al. “Algorithm description for Versatile Video Coding and Test Model 8 (VTM 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 7-17, 2020, doc… [cited by applicant]
Choi et al. “AHG17: On Decoded Picture Buffer Management for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M0154, 201… [cited by applicant]
Choi et al. “AHG12: on Sub-Picture Partitioning,” Joint Video Experts Teams (JVET) of ITU-T SG 16 WP 3 and iSO/IEC JTC 1/SC 29/WG 11 14th Meeting, Geneva, CH, Mar. 19-27, 2019, document JVET-N0055, 2019. [cited by applicant]
Choi et al. “AHG8/AHG12: On Sub-Picture Partitioning Support with Layers,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-O… [cited by applicant]
Choi et al. AHG8/AHG17: On Signaling Reference Picture Resampling, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P0219, 2019. [cited by applicant]
Fan et al. “CE6-2.3-Related: Reduced 8×8 Matrices for LFNST,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P0545, 2019. [cited by applicant]
Fu et al. “CE4-Related: Quadtree-Based Merge Estimation Region for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M035… [cited by applicant]
Gao et al. “Simplified GEO without Multiplication and Minimum Blending Mask Storage (Harmonization of JVET-P0107, JVET-P0264 and JVET-P0304),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/ SC 29… [cited by applicant]
Hannuksela et al. “AHG12: On Grouping of Tiles,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M0261, 2019. [cited by applicant]
Cited By (2)
US 12,513,291 US 12,621,450