IP Library Granted Patent US 12,483,702
Granted Patent B2
US 12,483,702 · App. 17/606,255 · Granted Nov 25, 2025

Apparatus, a method and a computer program for video coding and decoding

Inventor: Miska Hannuksela (Tampere, FI)
Assignee: Nokia Technologies Oy
H04N19/119H04N19/129H04N19/17H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,483,702
App. No.
17/606,255
Granted
Nov 25, 2025
Kind
B2
Abstract

A method comprising: determining a number of units that are to be assigned to partitions and are initialized as unassigned; indicating or inferring a number of explicitly sized partitions to be assigned; indicating sizes for the explicitly sized partitions and accordingly marking unassigned units as assigned to partitions in a pre-defined scan order; indicating a count of units; repetitively assigning the count of units to partitions and accordingly marking unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the count of units; and assigning, if the number of unassigned units is greater than 0, the unassigned units to a last partition.

Claims (57)

1 . A method comprising:

performing a video encoding process to form a bitstream, comprising:

determining a number of units that are to be assigned to partitions of tile columns in the bitstream and are initialized as unassigned, wherein the units correspond to parts of a picture of a video, wherein the number of units to be assigned to the partitions comprise at least a picture width expressed as a count of coding tree blocks;

signaling in or along the bitstream a number of explicitly sized partitions of the tile columns to be assigned;

signaling in or along the bitstream sizes for the explicitly sized partitions of the tile columns and accordingly marking unassigned units of the number of units as assigned to the explicitly sized partitions of the tile columns in a pre-defined scan order;

signaling in or along the bitstream a width of evenly sized tile columns;

repetitively assigning the width of evenly sized tile columns, among units remaining after unassigned units of the number of units have been assigned to the explicitly sized partitions using the pre-defined scan order, to the partitions and marking corresponding unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the width of evenly sized tile columns; and

assigning the unassigned units to a last partition, when the number of unassigned units is greater than zero; and

outputting the bitstream.

2 . An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus to:

performing a video encoding process to form a bitstream, comprising:

determine a number of units that are to be assigned to partitions of tile columns in the bitstream and are initialized as unassigned, wherein the units correspond to parts of a picture of a video, wherein the number of units to be assigned to the partitions comprise at least a picture width expressed as a count of coding tree blocks;

signal in or along the bitstream a number of explicitly sized partitions of tile columns to be assigned;

signal in or along the bitstream sizes for the explicitly sized partitions of the tile columns and accordingly mark unassigned units of the number of units as assigned to the explicitly sized partitions of the file columns in a pre-defined scan order;

signal in or along the bitstream a width of evenly sized tile columns;

repetitively assign the width of evenly sized tile columns, among units remaining after unassigned units of the number of units have been assigned to the explicitly sized partitions using the pre-defined scan order to the partitions and mark corresponding unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the width of evenly sized tile columns; and

assign the unassigned units to a last partition, when the number of unassigned units is greater than zero; and

outputting the bitstream.

3 . A method comprising:

performing a video decoding process using a bitstream to decode a picture, comprising:

determining, from or along a bitstream, a number of units that are to be assigned to partitions of tile columns from the bitstream, wherein the units correspond to parts of the picture from a video embodied in the bitstream, wherein the units to be assigned to the partitions comprise at least a picture width expressed as a count of coding tree blocks;

determining, from or along the bitstream, a number of explicitly sized partitions of the tile columns to be assigned;

determining, from or along the bitstream, sizes for the explicitly sized partitions of the tile columns and marking unassigned units of the number of units as assigned to the partitions of the tile columns in a pre-defined scan order;

determining, using at least the bitstream, a width of evenly sized tile columns;

repetitively assigning the width of the evenly sized tile columns, among units remaining after unassigned units have been assigned to the explicitly sized partitions using the pre-defined scan order, to partitions and marking unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the width of the evenly sized tile columns; and

assigning the unassigned units to a last partition, when the number of unassigned units is greater than zero; and

outputting information for the decoded picture.

4 . The method according to claim 3 , wherein:

determining the number of explicitly sized partitions of the tile columns to be assigned comprises decoding the number of explicitly sized ones of the partitions to be assigned from a syntax structure;

determining the sizes for the explicitly sized partitions of the tile columns comprises decoding the sizes for the explicitly sized partitions of the tile columns from the syntax structure; and

determining the width of the evenly sized tile columns comprises decoding the width of the evenly sized tile columns from the syntax structure.

5 . An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus to perform:

performing a video decoding process using a bitstream to decode a picture, comprising:

determine, from or along the bitstream, a number of units that are to be assigned to partitions of tile columns from the bitstream, wherein the units correspond to parts of the picture from a video embodied in the bitstream, wherein the units to be assigned to the partitions comprise at least a picture width expressed as a count of coding tree blocks;

determine, from or along the bitstream, a number of explicitly sized ones of the partitions of the tile columns to be assigned;

determine, from or along the bitstream, sizes for the explicitly sized partitions of the tile columns and mark unassigned units of the number of units as assigned to the partitions of the tile columns in a pre-defined scan order;

determine, using at least the bitstream, a width of evenly sized tile columns;

repetitively assign the width of evenly sized tile columns, among units remaining after unassigned units of the number of units have been assigned to the explicitly sized partitions using the pre-defined scan order, to partitions and mark unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the width of evenly sized tile columns; and

assign, the unassigned units to a last partition, when the number of unassigned units is greater than zero; and

outputting information for the decoded picture.

6 . A computer program product comprising at least one non-transitory computer-readable storage medium having computer executable program code instructions stored therein, the computer executable program code instructions comprising program code instructions configured, to, when executed on at least one processor, cause an apparatus or a system to perform at least:

performing a video decoding process using a bitstream to decode a picture, comprising:

determine, from or along a bitstream, a number of units that are to be assigned to partitions of tile columns from the bitstream, wherein the units correspond to parts of the picture from a video embodied in the bitstream, wherein the units to be assigned to the partitions comprise at least a picture width expressed as a count of coding tree blocks;

determine, from or along the bitstream, a number of explicitly sized ones of the partitions of the tile columns to be assigned;

determine, from or along the bitstream, sizes for the explicitly sized partitions of the tile columns and mark unassigned units of the number of units as assigned to the partitions of the tile columns in a pre-defined scan order;

determine, using at least the bitstream, a width of evenly sized tile columns;

repetitively assign the width of evenly sized tile columns, among units remaining after unassigned units have been assigned to the explicitly sized partitions using the pre-defined scan order, to partitions and mark unassigned units as assigned in the pre-defined scan order until the number of unassigned units is less than the width of evenly sized tile columns; and

assign the unassigned units to a last partition, when the number of unassigned units is greater than zero; and

outputting information for the decoded picture.

7 . The computer program product according to claim 6 , wherein:

determining the number of explicitly sized partitions of the tile columns to be assigned comprises decoding the number of explicitly sized ones of the partitions to be assigned from a syntax structure;

determining the sizes for the explicitly sized partitions of the tile columns comprises decoding the sizes for the explicitly sized partitions of the tile columns from the syntax structure; and

determining the width of the evenly sized tile columns comprises decoding the width of the evenly sized tile columns from the syntax structure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: HANNUKSELA, MISKA
To: NOKIA TECHNOLOGIES OY
Reel/Frame 057901/0375 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: HANNUKSELA, MISKA MATIAS
To: NOKIA TECHNOLOGIES OY
Reel/Frame 057901/0397 →
Priority Claims (2)
FI 20195465 · Jun 3, 2019 · national
FI 20195728 · Sep 3, 2019 · national
Continuity (1)
Related Publication 20220217342A1 · Jul 7, 2022
References Cited (56)
US 9386305B2 · Chong et al. · 2016 [cited by applicant]
US 20100150231A1 · Huang et al. · 2010 [cited by applicant]
US 20130202051A1 · Zhou · 2013 [cited by examiner]
US 20150016503A1 · Rapaka et al. · 2015 [cited by applicant]
US 20150023406A1 · Lee et al. · 2015 [cited by applicant]
US 20150110201A1 · Sasai et al. · 2015 [cited by applicant]
US 20150131716A1 · Cho et al. · 2015 [cited by applicant]
US 20150319462A1 · Ramasubramonian · 2015 [cited by examiner]
US 20160165248A1 · Lainema et al. · 2016 [cited by applicant]
US 20180376126A1 · Hannuksela · 2018 [cited by applicant]
CN 104685874A · 2015 [cited by applicant]
CN 105144720A · 2015 [cited by applicant]
CN 105359525A · 2016 [cited by applicant]
CN 105432082A · 2016 [cited by applicant]
CN 105981383A · 2016 [cited by applicant]
CN 109417642A · 2019 [cited by applicant]
CN 109792487A · 2019 [cited by applicant]
GB 2526148B · 2016 [cited by applicant]
JP 2015073213A · 2015 [cited by applicant]
RU 2538919C2 · 2015 [cited by applicant]
RU 2573194C1 · 2016 [cited by applicant]
WO 2020245497A1 · 2020 [cited by applicant]
Office Action received for corresponding Russian Patent Application No. 2021137086, dated Aug. 1, 2022, 7 pages of Office Action and 2 pages of translation available. [cited by applicant]
“Versatile Video Coding”, Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, Recommendation ITU-T H.266, Aug. 2020, 516 pages. [cited by applicant]
“High Efficiency Video Coding”, Series H: Audiovisual And Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Recommendation ITU-T H.265, Feb. 2018, 692 pages. [cited by applicant]
“Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Systems”, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Transmission Multiplexing and Sy… [cited by applicant]
“Information Technology—Coding of Audio-Visual Objects—Part 12: ISO Base Media File Format”, ISO/IEC 14496-12, Fifth edition, Dec. 15, 2015, 248 pages. [cited by applicant]
“Information Technology—Coding of Audio-Visual Objects—Part 15: Advanced Video Coding (AVC) File Format”, ISO/IEC 14496-15, First edition, Apr. 15, 2004, 29 pages. [cited by applicant]
“Video Coding For Low Bit Rate Communication”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving Video, ITU-T Recommendation H.263, Jan. 2005, 226 pages. [cited by applicant]
“Advanced Video Coding for Generic Audiovisual services”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving Video, Recommendation ITU-T H.264, Apr. 2017, 812 pages. [cited by applicant]
“Information Technology—Coding of Audio-Visual Objects—Part 10: Advanced Video Coding”, ISO/IEC 14496-10, Second edition, Oct. 1, 2004, 280 pages. [cited by applicant]
“Information technology—Coded representation of immersive media (MPEG-I)—Part 2: Omnidirectional media format”, ISO/IEC JTC 1/SC 29/WG 11, ISO/IEC FDIS 23090-2:201x (E), Apr. 26, 2018, 182 pages. [cited by applicant]
Office action received for corresponding Finnish Patent Application No. 20195728, dated May 4, 2020, 9 pages. [cited by applicant]
Hannuksela, “AHG17: On tile and brick signalling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-00390v2, 15th Meeting, Jul. 3-12, 2019, pp. 1-7. [cited by applicant]
Hannuksela, “AHG12: Signalling for tile and brick partitioning”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0857-v1, 14th Meeting, Mar. 19-27, 2019, pp. 1-3. [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2020/050367, dated Oct. 26, 2020, 16 pages. [cited by applicant]
Hannuksela, “AHG12: On signalling of tile and brick partitioning”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0096, 16th Meeting, Oct. 1-11, 2019, pp. 1-5. [cited by applicant]
Office Action received for corresponding Vietnamese Patent Application No. 1-2021-07352, dated Jan. 21, 2022, 1 page of Office Action and 1 page of translation available. [cited by applicant]
Office Action received for corresponding Vietnamese Patent Application No. 1-2021-08202, dated Jan. 21, 2022, 1 page of Office Action and 1 page of translation available. [cited by applicant]
Office action received for corresponding Indian Patent Application No. 202147061885, dated Apr. 28, 2022, 7 pages. [cited by applicant]
Office action received for corresponding Indian Patent Application No. 202147061886, dated Jun. 28, 2022, 6 pages. [cited by applicant]
Office action received for corresponding Finnish Patent Application No. 20195465, dated Jan. 30, 2020, 11 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1001-v7, 14th Meeting, Mar. 19-27, 2019, 383 pages. [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2020/050344, dated Oct. 23, 2020, 17 pages. [cited by applicant]
Chan et al., “Improve load balancing and coding efficiency of tiles in high efficiency video coding by adaptive tile boundary”, Journal of Electronic Imaging, vol. 26, No. 1, Jan./Feb. 2017, pp. 013006-1-013006-10. [cited by applicant]
Misra et al., “An Overview of Tiles in HEVC”, IEEE Journal of Selected Topics in Signal Processing, vol. 7, No. 6, Dec. 2013, pp. 969-977. [cited by applicant]
Office action received for corresponding Japanese Patent Application No. 2021-571893, dated Apr. 6, 2023, 5 page of office action and 4 pages of translation available. [cited by applicant]
Sjöberg et al., “AHG12: On Uniform Tile Partitioning”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0498, 14th Meeting, Mar. 19-27, 2019, pp. 1-7. [cited by applicant]
Fuldseth et al., “Tiles”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-F335, 6th Meeting, Jul. 14-22, 2011, pp. 1-15. [cited by applicant]
Office action received for corresponding Japanese Patent Application No. 2021-571894, dated Apr. 6, 2023, 2 page of office action and 3 pages of translation available. [cited by applicant]
Office action received for corresponding Russian Patent Application No. 2021137096, dated Aug. 12, 2022, 8 page of office action and 4 page of translation available. [cited by applicant]
Office action received for corresponding Canadian Patent Application No. 3140549, dated Jan. 12, 2023, 7 pages. [cited by applicant]
Office action received for corresponding Canadian Patent Application No. 3142319, dated Jan. 12, 2023, 6 pages. [cited by applicant]
Bross, Benjamin, et al., “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET), ITU-T SG 16 WP and ISO/IEC JTC 1/SC 29/WG 11, (Document JVET-Nlool-v5), May 2019, 370 pages. [cited by applicant]
Wang, Ye-Kui, et al., “AHG12 : Signalling for tile and brick partitioning”, Joint Video Experts Team (JVET), ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-N0857-v1), Mar. 2019, 4 pages . [cited by applicant]
“Doctoral Dissertation, 201211220101”, Jul. 2018. [cited by applicant]