IP Library Granted Patent US 12,341,981
Granted Patent B2
US 12,341,981 · App. 18/040,820 · Granted Jun 24, 2025

Information processing device and method

Inventors: Ryohei Takahashi (Tokyo, JP); Mitsuhiro Hirabayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/30H04N19/174H04N19/187H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,341,981
App. No.
18/040,820
Granted
Jun 24, 2025
Kind
B2
Abstract

The present disclosure relates to an information processing device and method capable of inhibiting an increase in a load on reproduction processing. Scalable decoding information is generated on the basis of a depth of a slice in the G-PCC content and a dependency relation between slices and is stored in the metadata area of the content file that stores the G-PCC content. Further, on the basis of the scalable decoding information stored in the metadata area of the content file, any slice of the G-PCC content is extracted from the content file and is decoded. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.

Claims (59)

1. An information processing device comprising:

circuitry configured to

generate scalable decoding information regarding scalable decoding of geometry-based point cloud compression (G-PCC) content on a basis of depth information indicating a quality hierarchy level of each slice in the G-PCC content including first and second slices and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track depth information regarding the depth information of the geometry of all the slices included in the track corresponding to the track configuration information, and

generate a content file that stores the G-PCC content and to store the scalable decoding information in a metadata area of the content file,

wherein the track depth information includes track minimum depth information indicating a minimum value of the depth information in the track and track maximum depth information indicating a maximum value of the depth information in the track.

2. The information processing device according to claim 1 , wherein the scalable decoding information includes slice configuration information regarding a configuration of the slice for each sample.

3. The information processing device according to claim 2 , wherein the circuitry is configured to set a subsample for each slice and stores the slice configuration information in a codec specific parameter of a subsample information box of the metadata area.

4. An information processing device comprising:

circuitry configured to

generate scalable decoding information regarding scalable decoding of geometry-based point cloud compression (G-PCC) content on a basis of depth information indicating a quality hierarchy level of each slice in the G-PCC content including first and second slices and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track depth information regarding the depth information of the geometry of all the slices included in the track corresponding to the track configuration information, and

generate a content file that stores the G-PCC content and to store the scalable decoding information in a metadata area of the content file,

wherein the circuitry is configured to store the track depth information in a depth information box of a sample entry of the metadata area.

5. An information processing device comprising:

circuitry configured to

generate scalable decoding information regarding scalable decoding of geometry-based point cloud compression (G-PCC) content on a basis of depth information indicating a quality hierarchy level of each slice in the G-PCC content including first and second slices and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track dependency relation information indicating a dependency relation between first and second tracks; and

generate a content file that stores the G-PCC content and to store the scalable decoding information in a metadata area of the content file,

wherein the track dependency relation information includes dependent information indicating another track including the slice necessary for decoding a dependent slice included in the track.

6. An information processing device comprising:

circuitry configured to

generate scalable decoding information regarding scalable decoding of geometry-based point cloud compression (G-PCC) content on a basis of depth information indicating a quality hierarchy level of each slice in the G-PCC content including first and second slices and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track dependency relation information indicating a dependency relation between first and second tracks; and

generate a content file that stores the G-PCC content and to store the scalable decoding information in a metadata area of the content file,

wherein the track dependency relation information includes independent information indicating another track including another slice in which an independent slice included in the track is necessary in decoding.

7. An information processing device comprising:

circuitry configured to

generate scalable decoding information regarding scalable decoding of geometry-based point cloud compression (G-PCC) content on a basis of depth information indicating a quality hierarchy level of each slice in the G-PCC content including first and second slices and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track dependency relation information indicating a dependency relation between first and second tracks; and

generate a content file that stores the G-PCC content and to store the scalable decoding information in a metadata area of the content file,

wherein the circuitry is configured to store the track dependency relation information in the metadata area as a track reference.

8. An information processing device comprising:

circuitry configured to

extract an arbitrary slice of geometry-based point cloud compression (G-PCC) content from a content file on a basis of scalable decoding information stored in a metadata area of the content file that stores the G-PCC content including first and second slices; and

decode the slice of the G-PCC content extracted by the extraction unit,

wherein the scalable decoding information is information regarding scalable decoding of the G-PCC content and is information generated on a basis of depth information indicating a quality hierarchy level of the slice in the G-PCC content and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track depth information regarding the depth information of the geometry of all the slices included in the track corresponding to the track configuration information,

wherein the track depth information includes track minimum depth information indicating a minimum value of the depth information in the track and track maximum depth information indicating a maximum value of the depth information in the track.

9. The information processing device according to claim 8 , wherein the scalable decoding information includes slice configuration information regarding a configuration of the slice for each sample.

10. An information processing method comprising:

extracting an arbitrary slice of geometry-based point cloud compression (G-PCC) content from a content file on a basis of scalable decoding information stored in a metadata area of the content file that stores the G-PCC content including first and second slices; and

decoding the extracted slice of the G-PCC content,

wherein the scalable decoding information is information regarding scalable decoding of the G-PCC content and is information generated on a basis of depth information indicating a quality hierarchy level of the slice in the G-PCC content and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes track configuration information regarding a configuration of a track that stores the G-PCC content on a slice basis in the content file, wherein the track configuration information includes

track depth information regarding the depth information of the geometry of all the slices included in the track corresponding to the track configuration information,

wherein the track depth information includes track minimum depth information indicating a minimum value of the depth information in the track and track maximum depth information indicating a maximum value of the depth information in the track.

11. An information processing device comprising:

circuitry configured to

extract an arbitrary slice of geometry-based point cloud compression (G-PCC) content from a content file on a basis of scalable decoding information stored in a metadata area of the content file that stores the G-PCC content including first and second slices; and

decode the slice of the G-PCC content extracted by the extraction unit,

wherein the scalable decoding information is information regarding scalable decoding of the G-PCC content and is information generated on a basis of depth information indicating a quality hierarchy level of the slice in the G-PCC content and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes at least one of

slice dependency relation information indicating the dependency relation between the first and second slices, wherein the slice dependency relation information includes reference source geometry slice identification information and reference destination geometry slice identification information, the reference source geometry slice identification information is identification information of a geometry slice serving as a reference source in the dependency relation between the first and second slices, and the reference destination geometry slice identification information is identification information of a geometry slice serving as a reference destination in the dependency relation between the first and second slices; and

geometry slice depth information regarding the depth information of the geometry included in a geometry slice, and wherein the geometry slice depth information includes minimum depth information indicating a minimum value of the depth information in the geometry slice and maximum depth information indicating a maximum value of the depth information in the geometry slice.

12. An information processing method comprising:

extracting an arbitrary slice of geometry-based point cloud compression (G-PCC) content from a content file on a basis of scalable decoding information stored in a metadata area of the content file that stores the G-PCC content including first and second slices; and

decoding the extracted slice of the G-PCC content,

wherein the scalable decoding information is information regarding scalable decoding of the G-PCC content and is information generated on a basis of depth information indicating a quality hierarchy level of the slice in the G-PCC content and a dependency relation between the first and second slices in the G-PCC content, wherein the scalable decoding information includes at least one of

slice dependency relation information indicating the dependency relation between the first and second slices, wherein the slice dependency relation information includes reference source geometry slice identification information and reference destination geometry slice identification information, the reference source geometry slice identification information is identification information of a geometry slice serving as a reference source in the dependency relation between the first and second slices, and the reference destination geometry slice identification information is identification information of a geometry slice serving as a reference destination in the dependency relation between the first and second slices; and

geometry slice depth information regarding the depth information of the geometry included in a geometry slice, and wherein the geometry slice depth information includes minimum depth information indicating a minimum value of the depth information in the geometry slice and maximum depth information indicating a maximum value of the depth information in the geometry slice.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2023
From: TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO
To: SONY GROUP CORPORATION
Reel/Frame 062610/0667 →
Continuity (2)
Provisional Application 63075361 · Sep 8, 2020
Related Publication 20230291918A1 · Sep 14, 2023
References Cited (13)
US 20210029187A1 · Oh · 2021 [cited by applicant]
US 20210329298A1 · Ramasubramonian · 2021 [cited by examiner]
US 20220366611A1 · Bai · 2022 [cited by examiner]
US 20230360273A1 · Oh · 2023 [cited by examiner]
WO 2020008106A1 · 2020 [cited by applicant]
WO 2020241723A1 · 2020 [cited by applicant]
WO 2021049333A1 · 2021 [cited by applicant]
International Search Report and Written Opinion mailed on Nov. 30, 2021, received for PCT Application PCT/JP2021/032594, filed on Sep. 6, 2021, 9 pages including English Translation. [cited by applicant]
“G-PCC Future Enhancements”, ISO/IEC JTC 1/SC 29/WG 11, N19328, Jun. 26, 2020, pp. 1-133. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 12 : ISO base media file format”, ISO/IEC 14496-12, Dec. 15, 2015, 388 pages. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 15: Carriage of network abstraction layer (NAL) unit structured video in the ISO base media file format”, ISO/IEC JTC 1/SC 29, ISO/IEC FDIS 14496-15:2014(E), J… [cited by applicant]
Flynn et al., “G-PCC: A hierarchical geometry slice structure”, Apple Inc., ISO/IEC JCTC1/SC29/WG11 MPEG/ m54677, Apr. 2020, pp. 1-9. [cited by applicant]
Oh et al., “Text of ISO/IEC CD 23090-18 Carriage of Geometry-based Point Cloud Compression Data”, ISO/IEC JTC 1/SC 29/WG 11, N19442, Jul. 30, 2020, pp. 1-24. [cited by applicant]