IP Library Granted Patent US 12,439,031
Granted Patent B2
US 12,439,031 · App. 18/489,678 · Granted Oct 7, 2025

Encoder, decoder, encoding method, and decoding method

Inventors: Kiyofumi Abe (Osaka, JP); Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Ryuichi Kanoh (Osaka, JP)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/105H04N19/119H04N19/139H04N19/14H04N19/176H04N19/52H04N19/573
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,439,031
App. No.
18/489,678
Granted
Oct 7, 2025
Kind
B2
Abstract

A decoder includes circuitry and memory. Using the memory, the circuitry, in a first operating mode, derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors. Using the memory, the circuitry, in a second operating mode, derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance.

Claims (41)

1. A decoder comprising:

circuitry; and

memory,

wherein, using the memory, the circuitry:

in a first operating mode,

derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and

generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors; and

in a second operating mode,

derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and

generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance.

2. An encoder comprising:

circuitry; and

memory,

wherein, using the memory, the circuitry:

in a first operating mode,

derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and

generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors;

in a second operating mode,

derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and

generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance; and

generates a bitstream including information for deriving the first motion vectors or the second motion vectors.

3. A bitstream generation device comprising:

circuitry; and

memory,

wherein, using the memory, the circuitry:

in a first operating mode,

derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and

generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors;

in a second operating mode,

derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and

generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance; and

generates a bitstream including information for deriving the first motion vectors or the second motion vectors.

4. A method of transmitting a bitstream comprising:

in a first operating mode,

deriving first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and

generating a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors;

in a second operating mode,

deriving second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and

generating a prediction image corresponding to the sub-block without referring to spatial gradients of luminance;

generating the bitstream including information for deriving the first motion vectors or the second motion vectors; and

transmitting the bitstream.

Continuity (6)
Continuation 17374085 · Jul 13, 2021
Continuation 16901869 · Jun 15, 2020
Continuation 16702254 · Dec 3, 2019
Continuation PCTJP2018020659 · May 30, 2018
Provisional Application 62515208 · Jun 5, 2017
Related Publication 20240048691A1 · Feb 8, 2024
References Cited (15)
US 5694487A · Lee · 1997 [cited by applicant]
US 20160191945A1 · Gurbuz · 2016 [cited by applicant]
US 20160366435A1 · Chien · 2016 [cited by examiner]
US 20170094305A1 · Li et al. · 2017 [cited by applicant]
US 20190045214A1 · Ikai et al. · 2019 [cited by applicant]
WO WO2017058899A1 · 2017 [cited by applicant]
WO WO2017134957A1 · 2017 [cited by applicant]
Alshina et al., “Known tools performance investigation for next generation video coding,” VCEG-AZ05, ITU—Telecommunications Standardization Sector, Study Group 16 Question 6, Video Coding Experts Group (VCEG), 52nd Meet… [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5), ” JVET-E1001-v2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 5th Meeting, Geneva, Switzerland, Jan… [cited by applicant]
Chen et al., “Further improvements to HMKTA-1.0,” VCEG-AZ07_v2, ITU—Telecommunications Standardization Sector, Study Group 16 Question 6, Video Coding Experts Group (VCEG), 52nd Meeting, Warsaw, Poland, Jun. 19-26, 2015… [cited by applicant]
International Search Report and Written Opinion, mailed Aug. 14, 2018, for International Application No. PCT/JP2018/020659, 7 pages. (with English translation). [cited by applicant]
International Standard, “Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 2: High efficiency video coding,” ISO/IEC 23008-2, First edition, Dec. 1, 2013, 312 pages. [cited by applicant]
Japanese Office Action, dated Mar. 10, 2020, for Japanese Application No. 2019-523480, 8 pages. (with English machine translation). [cited by applicant]
Qualcomm, “Harmonization and improvement for BIO,” Com16-C1045-E, Study Group 16—Contribution 1045, International Telecommunication Union, Telecommunication Standardization Sector, Sep. 2015, 5 pages. [cited by applicant]
Chen et al., “Improved Affine Motion Vector Coding,” JVET-D0128, Joint Video 1 Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016. (3 pages). [cited by applicant]