IP Library Granted Patent US 12,368,870
Granted Patent B2
US 12,368,870 · App. 18/514,382 · Granted Jul 22, 2025

Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus

Inventors: Semih Esenlik (Nazilli, TR); Matthias Narroschke (Schaafheim, DE); Thomas Wedi (The Hague, NL)
Assignee: SUN PATENT TRUST
H04N19/436H04N13/189H04N19/119H04N19/13H04N19/167H04N19/174H04N19/176H04N19/44H04N19/46H04N19/597H04N19/61H04N19/184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,368,870
App. No.
18/514,382
Granted
Jul 22, 2025
Kind
B2
Abstract

An image includes a plurality of rows of largest coding units (LCUs). Encoding the image includes determining whether or not wavefront parallel processing is enabled, and partitioning the plurality of rows of LCUs to comprise a normal slice and a group of dependent slices. The normal slice includes at least one LCU, and the group of dependent slices includes at least one LCU and consists of every dependent slice that uses information from a slice header of the normal slice for encoding. Based on the determination that wavefront parallel processing is enabled, the partitioning of the plurality of rows of LCUs is restricted such that a last LCU in the group of dependent slices belongs in a same row as a first LCU of the normal slice when the first LCU of the normal slice is not a first LCU of the row.

Claims (31)

1. A method of encoding an image, the image comprising a plurality of rows of largest coding units (LCUs), the method comprising:

determining whether or not wavefront parallel processing is enabled;

partitioning the plurality of rows of LCUs to comprise a normal slice and a group of dependent slices, whereby, the normal slice comprises at least one LCU, and, the group of dependent slices comprises at least one LCU and consists of every dependent slice that uses information from a slice header of the normal slice for encoding; and

restricting, based on the determination that wavefront parallel processing is enabled, the partitioning of the plurality of rows of LCUs such that a last LCU in the group of dependent slices belongs in a same row as a first LCU of the normal slice when the first LCU of the normal slice is not a first LCU of the row,

wherein the wavefront parallel processing includes synchronizing context and probability information in a beginning of each of the slices, and

in the synchronizing, a slice of a beginning of a second row does not refer to slice information of the normal slice in a first row.

2. The method of encoding an image according to claim 1 , further comprising

generating, for each slice of the normal slice and group of dependent slices, information indicating whether each slice is either a normal slice or a dependent slice.

3. The method of encoding an image according to claim 1 , further comprising

encoding an indicator into a bitstream indicating whether wavefront parallel processing is enabled.

4. The method of encoding an image according to claim 1 , further comprising

encoding the plurality of rows of LCUs in parallel using wavefront parallel processing.

5. An image encoding device, the image comprising a plurality of rows of largest coding units (LCUs), the device comprising:

circuitry configured to:

determine whether or not wavefront parallel processing is enabled;

partition the plurality of rows of LCUs to comprise a normal slice and a group of dependent slices, whereby, the normal slice comprises at least one LCU, and, the group of dependent slices comprises at least one LCU and consists of every dependent slice that uses information from a slice header of the normal slice for encoding; and

restrict, based on the determination that wavefront parallel processing is enabled, the partitioning of the plurality of rows of LCUs such that a last LCU in the group of dependent slices belongs in a same row as a first LCU of the normal slice when the first LCU of the normal slice is not a first LCU of the row,

wherein the wavefront parallel processing includes synchronizing context and probability information in a beginning of each of the slices, and

in the synchronizing, a slice of a beginning of a second row does not refer to slice information of the normal slice in a first row.

6. The image encoding device according to claim 5 , wherein the circuitry is further configured to generate, for each slice of the normal slice and group of dependent slices, information indicating whether each slice is either a normal slice or a dependent slice.

7. The image encoding device according to claim 5 , wherein the circuitry is further configured to encode an indicator into a bitstream indicating whether wavefront parallel processing is enabled.

8. The image encoding device according to claim 5 , wherein the circuitry is further configured to encode the plurality of rows of LCUs in parallel using wavefront parallel processing.

9. A non-transitory computer readable medium storing a computer executable program that, when executed, causes a processor to encode an image, the image comprising a plurality of rows of largest coding units (LCUs), the processor being caused to:

determine whether or not wavefront parallel processing is enabled;

partition the plurality of rows of LCUs to comprise a normal slice and a group of dependent slices, whereby, the normal slice comprises at least one LCU, and, the group of dependent slices comprises at least one LCU and consists of every dependent slice that uses information from a slice header of the normal slice for encoding; and

restrict, based on the determination that wavefront parallel processing is enabled, the partitioning of the plurality of rows of LCUs such that a last LCU in the group of dependent slices belongs in a same row as a first LCU of the normal slice when the first LCU of the normal slice is not a first LCU of the row,

wherein the wavefront parallel processing includes synchronizing context and probability information in a beginning of each of the slices, and

in the synchronizing, a slice of a beginning of a second row does not refer to slice information of the normal slice in a first row.

10. The non-transitory computer readable medium according to claim 9 , wherein the processor is further caused to generate, for each slice of the normal slice and group of dependent slices, information indicating whether each slice is either a normal slice or a dependent slice.

11. The non-transitory computer readable medium according to claim 9 , wherein the processor is further caused to encode an indicator into a bitstream indicating whether wavefront parallel processing is enabled.

12. The non-transitory computer readable medium according to claim 9 , wherein the processor is further caused to encode the plurality of rows of LCUs in parallel using wavefront parallel processing.

Continuity (10)
Continuation 17536159 · Nov 29, 2021
Continuation 16919209 · Jul 2, 2020
Continuation 15970185 · May 3, 2018
Continuation 15591381 · May 10, 2017
Continuation 15211475 · Jul 15, 2016
Continuation 15009172 · Jan 28, 2016
Continuation 14707439 · May 8, 2015
Continuation 14032414 · Sep 20, 2013
Provisional Application 61705864 · Sep 26, 2012
Related Publication 20240089478A1 · Mar 14, 2024
References Cited (37)
US 9100634B2 · Esenlik et al. · 2015 [cited by applicant]
US 9282334B2 · Esenlik et al. · 2016 [cited by applicant]
US 9420297B2 · Esenlik · 2016 [cited by examiner]
US 9693067B2 · Esenlik et al. · 2017 [cited by applicant]
US 9992505B2 · Esenlik · 2018 [cited by examiner]
US 10743010B2 · Esenlik et al. · 2020 [cited by applicant]
US 11212544B2 · Esenlik · 2021 [cited by examiner]
US 11863772B2 · Esenlik · 2024 [cited by examiner]
US 20100232767A1 · Sasaki et al. · 2010 [cited by applicant]
US 20130003823A1 · Misra et al. · 2013 [cited by applicant]
US 20130107952A1 · Coban · 2013 [cited by applicant]
US 20130114736A1 · Wang · 2013 [cited by examiner]
US 20150023409A1 · Schierl · 2015 [cited by examiner]
US 20150208095A1 · Schierl · 2015 [cited by applicant]
US 20180020222A1 · Wu · 2018 [cited by applicant]
WO 2010100875 · 2010 [cited by applicant]
Gordon Clare et al., “Wavefront Parallel Processing for HEVC Encoding and Decoding”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-F274, Ver.2, 6th Meeting: Torino… [cited by applicant]
Sung-Chang Lim et al., “CE4 Subtest2: Cross-check report of Sony's proposal JCTVC-F420 (tests 2.3.d and 2.3.e) by ETRI”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JC… [cited by applicant]
Benjamin Bross et al., “High efficiency video coding (HEVC) text specification draft 8”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-J1003_d7, Ver.8, 10th Meetin… [cited by applicant]
Tammy Lee and Jeonghoon Park, “On dependent slices”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-J0217_rl, 10 [cited by applicant]
T. Schierl et al., “Dependent slices”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-I0229rl, 9 [cited by applicant]
Semih Esenlik et al., “AHG4: Dependent slices restriction”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-K0183, 11 [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard”, Dec. 2012. [cited by applicant]
Pourazad et al., “HEVC: The New Gold Standard for Video Compression”, Jul. 2012. [cited by applicant]
Schwarz et al., “Overview of the Scalable Video Coding Extension of the H.264/AVC Standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 9, Sep. 2007. [cited by applicant]
Benjamin Bross et al., “High efficiency video coding (HEVC) text specification draft 8”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 10 [cited by applicant]
Muhammed Coban et al., “Restriction on coexistence of WPP and slices”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 9 [cited by applicant]
Sullivan et al., “Video Compression—From Concepts to the H.264/AVC Standard”, Proceedings of the IEEE, vol. 93, No. 1, Jan. 2005. [cited by applicant]
T. Schierl et al., “Dependent slices”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, JCTVC-10229, 9th Meeting: Geneva, CH, Apr. 27-May 7, 2012, pp. 1-7. [cited by applicant]
T. Schierl et al, “Dependent slices support in HEVC main profile” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, Document JCTVC-J0264, 10 [cited by applicant]
B. Bross et al, “High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Last Call)” Document JCTVC-L1003_v34, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/… [cited by applicant]
Henry et al, “Combined proposal JCTVC-E196 and JCT-VCE409” Document JCTVC-E470, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5 [cited by applicant]
Declaration of Dr. Vijay K. Madisetti, United States Patent and Trademark Office, Before the Patent Trial and Appeal Board, [cited by applicant]
Declaration of Dr. Ajay Luthra, United States Patent and Trademark Office, Before the Patent Trial and Appeal Board, [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 9,100,634, United States Patent and Trademark Office, Before the Patent Trial and Appeal Board, [cited by applicant]
U.S. Appl. No. 61/705,891, filed Sep. 26, 2012, Esenlik et al, 111 pages. [cited by applicant]
Office Action issued Dec. 13, 2019 in corresponding Indian Patent Application No. 1310/CHENP/2015. [cited by applicant]