IP Library › Granted Patent US 12,323,626
Granted Patent B2
US 12,323,626 · App. 17/911,677 · Granted Jun 3, 2025

Information processing device and information processing method

Inventors: Mitsuru Katsumata (Tokyo, JP); Ryohei Takahashi (Tokyo, JP); Mitsuhiro Hirabayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/70H04N19/167H04N19/172H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,626
App. No.
17/911,677
Granted
Jun 3, 2025
Kind
B2
Abstract

A decrease in bit efficiency is suppressed. An information processing device includes an encoding unit ( 101 ) that encodes a picture including two or more subpictures to generate encoded data; a metadata generation unit ( 102 ) that generates subpicture mapping information including first size information of a first subpicture among the two or more subpictures and information that second size information of each of one or more second subpictures other than the first subpicture being considered the same as the first size information of the first subpicture; and a bitstream generation unit ( 103 ) that generates a bitstream including the encoded data and the subpicture mapping information.

Claims (85)

1. An information processing device comprising:

a control circuitry that:

encodes a picture including two or more subpictures to generate encoded data;

generates subpicture mapping information that includes:

first size information indicating a size of a first subpicture among the two or more subpictures,

reference position information indicating X and Y coordinates of a reference pixel in the first subpicture, and

a size flag indicating whether or not a size of each of one or more second subpictures is the same as the size of the first subpicture; and

generates a bitstream including the encoded data and the subpicture mapping information,

wherein:

based on the size flag indicating that the size of each of the one or more second subpictures is not the same as the size of the first subpicture, the subpicture mapping information further includes:

information identifying the size of each of the one or more second subpictures, and

reference position information indicating X and Y coordinates of a reference pixel in each of the one or more second subpictures, and

based on the size flag indicating that the size of each of the one or more second subpictures is the same as the size of the first subpicture, the subpicture mapping information:

omits additional information identifying the size of each of the one or more second subpictures, and

omits the reference position information indicating X and Y coordinates of the reference pixel in each of the one or more second subpictures.

2. The information processing device according to claim 1 , wherein

the size of the first subpicture is defined in coding tree unit (CTU).

3. The information processing device according to claim 1 , wherein

the first subpicture is a subpicture located at an upper left end of the picture.

4. The information processing device according to claim 1 , wherein

the first size information includes information on a width and a height of the first subpicture.

5. The information processing device according to claim 1 , wherein

the subpicture mapping information further includes position information indicating a position of each of the first subpicture and the one or more second subpictures in the picture.

6. The information processing device according to claim 1 , wherein

the subpicture mapping information further includes:

first position information indicating a position of the first subpicture in the picture, and

a position flag indicating whether or not a position of each of the one or more second subpictures in the picture is to be determined on the basis of the first position information and the first size information.

7. An information processing device comprising:

a control circuitry that:

acquires encoded data and subpicture mapping information from a bitstream;

decodes the encoded data to restore a picture, and segments the restored picture into two or more subpictures on the basis of the subpicture mapping information; and

renders the picture according to the two or more subpictures,

wherein the subpicture mapping information includes:

first size information identifying a size of a first subpicture among the two or more subpictures,

reference position information indicating X and Y coordinates of a reference pixel in the first subpicture, and

a size flag indicating whether or not a size of each of one or more second subpictures is the same as the size of the first subpicture,

wherein:

based on the size flag indicating that the size of each of the one or more second subpictures is not the same as the size of the first subpicture, the subpicture mapping information further includes:

information identifying the size of each of the one or more second subpictures, and

reference position information indicating X and Y coordinates of a reference pixel in each of the one or more second subpictures, and

based on the size flag indicating that the size of each of the one or more second subpictures is the same as the size of the first subpicture, the subpicture mapping information:

omits additional information identifying the size of each of the one or more second subpictures, and

omits the reference position information indicating X and Y coordinates of the reference pixel in each of the one or more second subpictures.

8. The information processing device according to claim 7 , wherein

the size of the first subpicture is defined in coding tree unit (CTU).

9. The information processing device according to claim 7 , wherein

the first subpicture is a subpicture located at an upper left end of the picture.

10. The information processing device according to claim 7 , wherein

the first size information includes information on a width and a height of the first subpicture.

11. The information processing device according to claim 7 , wherein

the subpicture mapping information further includes position information indicating a position of each of the first subpicture and the one or more second subpictures in the picture.

12. The information processing device according to claim 7 , wherein

the subpicture mapping information further includes:

first position information indicating a position of the first subpicture in the picture, and

a position flag indicating whether or not a position of each of the one or more second subpictures in the picture is to be determined on the basis of the first position information and the first size information, and

the control circuitry calculates the second position information indicating a position of each of the one or more second subpictures in the picture on the basis of the first position information and the first size information.

13. An information processing method performed by an information processing device, the method comprising:

encoding a picture including two or more subpictures to generate encoded data;

generating subpicture mapping information that includes:

first size information indicating a size of a first subpicture among the two or more subpictures,

reference position information indicating X and Y coordinates of a reference pixel in the first subpicture, and

a size flag indicating whether or not a size of each of one or more second subpictures is the same as the size of the first subpicture; and

generating a bitstream including the encoded data and the subpicture mapping information,

wherein:

based on the size flag indicating that the size of each of the one or more second subpictures is not the same as the size of the first subpicture, the subpicture mapping information further includes:

information identifying the size of each of the one or more second subpictures, and

reference position information indicating X and Y coordinates of a reference pixel in each of the one or more second subpictures, and

based on the size flag indicating that the size of each of the one or more second subpictures is the same as the size of the first subpicture, the subpicture mapping information:

omits additional information identifying the size of each of the one or more second subpictures, and

omits the reference position information indicating X and Y coordinates of the reference pixel in each of the one or more second subpictures.

14. An information processing method performed by an information processing device, the method comprising:

acquiring encoded data and subpicture mapping information from a bitstream;

decoding the encoded data to restore a picture, and segmenting the restored picture into two or more subpictures on the basis of the subpicture mapping information; and

rendering the picture according to the two or more subpictures,

wherein the subpicture mapping information includes:

first size information identifying a size of a first subpicture among the two or more subpictures,

reference position information indicating X and Y coordinates of a reference pixel in the first subpicture, and

a flag indicating whether or not a size of each of one or more second subpictures is the same as the size of the first subpicture,

wherein:

based on the size flag indicating that the size of each of the one or more second subpictures is not the same as the size of the first subpicture, the subpicture mapping information further includes:

information identifying the size of each of the one or more second subpictures, and

reference position information indicating X and Y coordinates of a reference pixel in each of the one or more second subpictures, and

based on the size flag indicating that the size of each of the one or more second subpictures is the same as the size of the first subpicture, the subpicture mapping information:

omits additional information identifying the size of each of the one or more second subpictures, and

omits the reference position information indicating X and Y coordinates of the reference pixel in each of the one or more second subpictures.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: KATSUMATA, MITSURU; TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO
To: SONY GROUP CORPORATION
Reel/Frame 061105/0302 →
Continuity (3)
Provisional Application 63026901 · May 19, 2020
Provisional Application 63000565 · Mar 27, 2020
Related Publication 20230179801A1 · Jun 8, 2023
References Cited (26)
US 10271076B2 · Hirabayashi · 2019 [cited by examiner]
US 10419801B2 · Hirabayashi · 2019 [cited by examiner]
US 10951871B2 · Takahashi · 2021 [cited by examiner]
US 11375232B2 · Wu · 2022 [cited by examiner]
US 11671625B2 · Hannuksela · 2023 [cited by examiner]
US 20170201757A1 · Goldman · 2017 [cited by examiner]
US 20190082178A1 · Kim · 2019 [cited by examiner]
US 20220182681A1 · Paluri · 2022 [cited by examiner]
GB 2587243 · 2019 [cited by examiner]
GB 2585111 · 2019 [cited by examiner]
GB 2590632 · 2019 [cited by examiner]
WO 2018221368A1 · 2018 [cited by applicant]
WO WO2020141248 · 2020 [cited by examiner]
WO WO2020141260 · 2020 [cited by examiner]
WO WO2020185892 · 2020 [cited by examiner]
H.264 Standard (Year: 2014). [cited by examiner]
H.265 Standard (Year: 2016). [cited by examiner]
H.266 Standard Draft—Version 8 (Year: 2020). [cited by examiner]
International Search Report and Written Opinion mailed on Jun. 1, 2021, received for PCT Application PCT/JP2021/011360, filed on Mar. 19, 2021, 12 pages including English Translation. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-O2001-vE, Jul. 3-12, 2019, 17 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001-vE, Jan. 7-17, 2020, 21 pages. [cited by applicant]
Katsumata et al., “AHG12: Cleanup of subpicture layout signalling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11, JVET-S0071-v5, Jun. 22-Jul. 1, 2020, pp. 1-9. [cited by applicant]
Sjoberg et al., “AHG12: On Uniform Tile Partitioning”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JVET-N0498, Mar. 19-27, 2019, pp. 1-7. [cited by applicant]
Wang et al., “Tile groups”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-H0520rl, Feb. 1-10, 2012, pp. 1-8. [cited by applicant]
Zhou, “AHG4: Sub-stream entry points SEI message”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC 29/WG11, JCTVC-K0200, Oct. 10-19, 2012, pp. 1-8. [cited by applicant]
Bross Bet al: “Versatile Video Coding (Draft 5) ”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16) No. JVET-N1001 Jul. 2, 2019 (Jul. 2,… [cited by applicant]