IP Library › Granted Patent US 12,278,959
Granted Patent B2
US 12,278,959 · App. 18/227,683 · Granted Apr 15, 2025

Encoder and decoder, encoding method and decoding method with complexity handling for flexibly sized picture partitions

Inventors: Robert Philipp Skupin (Einsteinufer, DE); Yago Sánchez De La Fuente (Einsteinufer, DE); Cornelius Hellge (Einsteinufer, DE); Thomas Schierl (Einsteinufer, DE); Karsten Sühring (Einsteinufer, DE); Thomas Wiegand (Einsteinufer, DE)
Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
H04N19/119H04N19/105H04N19/156H04N19/172H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,278,959
App. No.
18/227,683
Granted
Apr 15, 2025
Kind
B2
Abstract

A video encoder according to embodiments is provided. The video encoder is configured for encoding a plurality of pictures of a video by generating an encoded video signal, wherein each of the plurality of pictures has original picture data. The video encoder has a data encoder configured for generating the encoded video signal having encoded picture data, wherein the data encoder is configured to encode the plurality of pictures of the video into the encoded picture data. Moreover, the video encoder has an output interface configured for outputting the encoded picture data of each of the plurality of pictures. Furthermore, a video decoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.

Claims (30)

1. A hardware apparatus for video encoding, the hardware apparatus configured to:

encode a first flag for a segment of a current picture into a data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, encode a second flag into the data stream that indicates whether or not a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded using IBC, the current block is predicted by copying samples from a reference block of reconstructed samples of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determine a prediction of the current block by copying samples from the reference block of reconstructed samples of the current picture; and

encode a prediction residual into the data stream based on the prediction of the current block.

2. A hardware apparatus for video decoding, the hardware apparatus configured to:

decode a first flag for a segment of a current picture from a data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, decode a second flag from the data stream that indicates whether a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded using IBC, the current block is predicted by copying samples from a reference block of reconstructed samples of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determine a prediction of the current block by copying samples from the reference block of reconstructed samples of the current picture; and

reconstruct the current block based on the prediction of the current block and a prediction residual decoded from the data stream.

3. A method of video encoding, the method comprising:

encoding a first flag for a segment of a current picture into a data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, encoding a second flag into the data stream that indicates whether a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded using IBC, the current block is predicted by copying samples from a reference block of reconstructed samples of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determining a prediction of the current block by copying samples from the reference block of reconstructed samples of the current picture; and

encoding a prediction residual into the data stream based on the prediction of the current block.

4. A method of video decoding, the method comprising:

decoding a first flag for a segment of a current picture from a data stream, the segment encoded into the data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, decoding a second flag from the data stream that indicates whether a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded using IBC, the current block is predicted by copying samples from a reference block of reconstructed samples of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determining a prediction of the current block by copying samples from the reference block of reconstructed samples of the current picture; and

reconstructing the current block based on the prediction of the current block and a prediction residual decoded from the data stream.

5. A non-transitory digital storage medium having a computer program stored thereon to perform, when the computer program is run by a computer, the steps of:

decoding a first flag for a segment of a current picture from a data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, decoding a second flag from the data stream that indicates whether or not a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded with IBC, the current block is predicted by copying samples from a reference block of reconstructed samples of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determining a prediction of the current block by copying samples from the reference block of reconstructed samples of the current picture; and

reconstructing the current block based on the prediction of the current block and a prediction residual decoded from the data stream.

6. A non-transitory digital storage medium having a computer program stored thereon to perform, when the computer program is run by a computer, the steps of:

encoding a first flag for a segment of a current picture into a data stream, wherein the first flag indicates whether blocks of the segment are intra-predicted only, meaning that the blocks of the segment are predicted based on reconstructed samples of the current picture only;

responsive to the first flag indicating that the blocks of the segment are intra-predicted only, encoding a second flag into the data stream that indicates whether or not a current block of the segment is encoded using intra block copy (IBC), wherein when the current block is encoded using IBC, the current block is predicted by copying samples from a reference block of the current picture;

responsive to the second flag indicating that the current block is encoded using IBC, determining a prediction of the current block by copying samples from the reference block of the current picture; and

encoding a prediction residual into the data stream based on the prediction of the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2023
From: SKUPIN, ROBERT PHILIPP; SÁNCHEZ DE LA FUENTE, YAGO; HELLGE, CORNELIUS; SCHIERL, THOMAS; SÜHRING, KARSTEN; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 064422/0675 →
Priority Claims (1)
EP 18248303 · Dec 28, 2018 · regional
Continuity (2)
Continuation 16777180 · Jan 30, 2020
Related Publication 20230370596A1 · Nov 16, 2023
References Cited (26)
US 10313682B2 · Pang · 2019 [cited by applicant]
US 20150016505A1 · Sjoberg et al. · 2015 [cited by applicant]
US 20160050424A1 · Choi · 2016 [cited by applicant]
US 20160227244A1 · Rosewarne · 2016 [cited by examiner]
US 20180176603A1 · Fujimoto · 2018 [cited by applicant]
US 20190325615A1 · Park · 2019 [cited by applicant]
US 20190387239A1 · Wang · 2019 [cited by applicant]
US 20200177911A1 · Aono · 2020 [cited by applicant]
US 20210006783A1 · Skupin et al. · 2021 [cited by applicant]
US 20210160533A1 · Zhang · 2021 [cited by examiner]
AU 2017203354B2 · 2017 [cited by applicant]
JP 2016534649 · 2016 [cited by applicant]
WO WO2016208241A1 · 2016 [cited by applicant]
IN First Examination Report mailed Apr. 8, 2022 in IN Application 202137029334. [cited by applicant]
Japanese office action dated Sep. 6, 2022, in Japanese patent application 2021-538095. [cited by applicant]
Fuldseth A: “Replacing slices with tiles for high level parallelism,” 4. JCT-VC Meeting; 95. MPEG Meeting, Jan. 2011, No. JCTVC-D227, XP030008267, Jan. 2011. [cited by applicant]
Skupin R. et al.: “AHG12: On tiles with partial CTUs,” 13. JVET Meeting, Jan. 2019, Marrakech, No. Jvet-M0459, XP030201803, Jan. 2019. [cited by applicant]
Yasugi Y. et al.: “AHG12: Flexible tile partitioning,” 12. JVET Meeting 2018, Macao, No. JVET-L0359, Oct. 11, 2018, XP030195385, Oct. 2018. [cited by applicant]
ITU-T, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video—High efficiency video coding. ITU-T Recommendation H.265, Apr. 2013, 2013. [cited by applicant]
ITU-T, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video—High efficiency video coding. ITU-T Recommendation H.265, Oct. 2014, 2014. [cited by applicant]
Suehring, Karsten et al., Document JVET-M0386, Title: AHG17: On slice_type (tile_group_type), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 201… [cited by applicant]
Bross, Benjamin et al., Document: JVET-M1001-v7, Title: Versatile Video Coding (Draft 4), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 3… [cited by applicant]
Bing, Benny, “Next-Generation Video Coding and Streaming,” H.265/HEVC Standard, First Edition, © 2015 John Wiley & Sons, Inc., Published 2015 by John Wiley & Sons, Inc., pp. 115-164. [cited by applicant]
Recommendation ITU-T H.265 (Apr. 2013), Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, High Efficiency Video Coding, 317 pp. [cited by applicant]
Deshpande, Sachin, JVET-10450-v1, On Reference Pictures Signaling and Management for VVC, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 12 [cited by applicant]
Xu, Xiaochong et al., JVET-K0075-v3, CE8-2.1: Current Picture Referencing Using Block Level Flag Signaling, Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11 [cited by applicant]