IP Library Granted Patent US 12,238,320
Granted Patent B2
US 12,238,320 · App. 18/203,188 · Granted Feb 25, 2025

Non-transitory computer-readable medium and device for performing inter prediction in video coding

Inventors: Kiran Mukesh Misra (Vancouver, WA); Frank Bossen (Vancouver, WA); Christopher Andrew Segall (Vancouver, WA)
Assignee: SHARP KABUSHIKI KAISHA
H04N19/46H04N19/105H04N19/159H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,320
App. No.
18/203,188
Granted
Feb 25, 2025
Kind
B2
Abstract

A non-transitory computer-readable medium of a device storing computer-executable instructions is provided. When the instructions are executed by one or more processors of the device, the instructions cause the device to: decode a merge subblock flag that specifies whether subblock-based inter prediction parameters for a coding unit are inferred from neighboring blocks and that determines whether a motion vector difference merge flag and a combination flag are to be decoded; determine a value of the merge subblock flag; decode the motion vector difference merge flag after the value of the merge subblock flag is determined as being equal to zero and a value of a motion vector difference flag is determined as being equal to one; and decode the combination flag that specifies whether a combined inter-picture merge and intra-picture prediction is applied to the coding unit by using the merge subblock flag and a sequence parameter set (SPS) flag.

Claims (21)

1. A non-transitory computer-readable medium of a device storing one or more computer-executable instructions that, when executed by one or more processors of the device, cause the device to:

decode a merge subblock flag that specifies whether subblock-based inter prediction parameters for a coding unit are inferred from neighboring blocks and that determines whether a motion vector difference merge flag and a combination flag are to be decoded;

determine a value of the merge subblock flag;

decode the motion vector difference merge flag after the value of the merge subblock flag is determined as being equal to zero and a value of a motion vector difference flag is determined as being equal to one; and

decode the combination flag that specifies whether a combined inter-picture merge and intra-picture prediction is applied to the coding unit by using the merge subblock flag and a sequence parameter set (SPS) flag for the combined inter-picture merge and intra-picture prediction,

wherein:

the motion vector difference merge flag specifies that a prediction parameter with a motion vector difference is used, and

the motion vector difference flag specifies whether a merge mode with motion vector difference (MMVD) mode is enabled.

2. The non-transitory computer-readable medium of claim 1 , wherein the one or more computer-executable instructions, when executed by the one or more processors, further cause the device to:

decode the combination flag that specifies whether the combined inter-picture merge and intra-picture prediction is applied to the coding unit after the value of the merge subblock flag is determined as being equal to zero and the SPS flag for the combined inter-picture merge and intra-picture prediction is determined as being equal to one.

3. A device comprising:

one or more processors; and

one or more non-transitory computer-readable media coupled to the one or more processors and storing one or more computer-executable instructions that, when executed by at least one of the one or more processors, cause the device to:

code a merge subblock flag that specifies whether subblock-based inter prediction parameters for a coding unit are inferred from neighboring blocks and that determines whether a motion vector difference merge flag and a combination flag are to be coded;

code the motion vector difference merge flag after a value of the merge subblock flag is determined as being equal to zero and a value of a motion vector difference flag is determined as being equal to one; and

code the combination flag that specifies whether a combined inter-picture merge and intra-picture prediction is applied to the coding unit by using the merge subblock flag and a sequence parameter set (SPS) flag for the combined inter-picture merge and intra-picture prediction,

wherein:

the motion vector difference merge flag specifies that a prediction parameter with a motion vector difference is used, and

the motion vector difference flag specifies whether a merge mode with motion vector difference (MMVD) mode is enabled.

4. The device of claim 3 , wherein the one or more computer-executable instructions, when executed by the at least one of the one or more processors, further cause the device to:

code the combination flag that specifies whether the combined inter-picture merge and intra-picture prediction is applied to the coding unit after the value of the merge subblock flag is determined as being equal to zero and the SPS flag for the combined inter-picture merge and intra-picture prediction is determined as being equal to one.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2024
From: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
To: SHARP KABUSHIKI KAISHA
Reel/Frame 069027/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2023
From: MISRA, KIRAN MUKESH; BOSSEN, FRANK; SEGALL, CHRISTOPHER ANDREW
To: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
Reel/Frame 063792/0686 →
Continuity (3)
Continuation 17416645
Provisional Application 62784014 · Dec 21, 2018
Related Publication 20230308675A1 · Sep 28, 2023
References Cited (23)
US 20150023422A1 · Zhang et al. · 2015 [cited by applicant]
US 20200021814A1 · Xu · 2020 [cited by examiner]
US 20200154101A1 · Li · 2020 [cited by examiner]
US 20200177873A1 · Li · 2020 [cited by examiner]
US 20210243476A1 · Ko · 2021 [cited by examiner]
US 20220078488A1 · Leleannec · 2022 [cited by examiner]
CN 105493505A · 2016 [cited by applicant]
CN 105637870A · 2016 [cited by applicant]
CN 107079161A · 2017 [cited by applicant]
WO 2015142057A1 · 2015 [cited by applicant]
International Standard, “Information technology—Coding ofaudio-visual objects—Part 2: Visual”, ISO/IEC 14496-2:2001(E), Dec. 1, 2001. [cited by applicant]
Telecommunication Standardization Sector of ITU, “Advanced video coding for generic audiovisual services”, Recommendation ITU-T H.264, (Apr. 2017). [cited by applicant]
Telecommunication Standardization Sector of ITU, “High efficiency video coding”, Recommendation ITU-T H.265, (Feb. 2018). [cited by applicant]
Output document of JVET, “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, JVET-G1001-v1, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, … [cited by applicant]
Output document approved by JVET, “Versatile Video Coding (Draft 1)”, JVET-J1001-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20, 2018. [cited by applicant]
Output document approved by JVET, “Versatile Video Coding (Draft 2)”, JVET-K1001-v7, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018. [cited by applicant]
Output document approved by JVET, “Versatile Video Coding (Draft 3)”, JVET-L1001-v6, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018. [cited by applicant]
Non-Final Rejection dated Apr. 15, 2022 for U.S. Appl. No. 17/416,645 which is the parent application of the instant application. [cited by applicant]
Final Rejection dated Aug. 4, 2022 for U.S. Appl. No. 17/416,645 which is the parent application of the instant application. [cited by applicant]
Notice of Allowance dated Mar. 2, 2023 for U.S. Appl. No. 17/416,645 which is the parent application of the instant application. [cited by applicant]
Li Hao et al.: “A Motion Aided Merge Mode For Hevc”, 2018 IEEE International Conference On Acoustics, Speech and Signal Processing (ICASSP), IEEE, Apr. 15, 2018 (Apr. 15, 2018). [cited by applicant]
Fu (Huawei), T et al.: “Non-CE4: separate merge candidate list for sub-block modes”, JVET-K0364-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 11th Meeting: Ljubljana, SI, Jul. 10-… [cited by applicant]
Fukushima (JK-Holdings), S et al.: “Merge based mvd transmission”, JCTVC-F373, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, IT, Jul. 14-22, 2011 (J… [cited by applicant]