IP Library Granted Patent US 12,418,679
Granted Patent B2
US 12,418,679 · App. 18/041,834 · Granted Sep 16, 2025

Information processing apparatus and method

Inventors: Yuka Kiyama (Tokyo, JP); Ryohei Takahashi (Tokyo, JP); Mitsuhiro Hirabayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/597G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,418,679
App. No.
18/041,834
Granted
Sep 16, 2025
Kind
B2
Abstract

The present disclosure relates to an information processing apparatus and method capable of suppressing an increase in a load of a reproduction process. A scene description file that describes a scene of 3D object content is generated, the scene description file including information associated with Media Presentation Description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH) and information regarding encoding of Representation included in Adaptation Set in the MPD. Furthermore, the scene description file is analyzed, the 3D object content to be decoded is selected on the basis of the information regarding the encoding of the Representation, and the encoded data of the selected 3D content is decoded. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, or the like.

Claims (68)

1. An information processing apparatus comprising:

processing circuitry configured to generate a scene description file that describes a scene of 3D object content, wherein

the scene description file includes information associated with a media presentation description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH),

the scene description file includes codec information for each of a plurality of Representations, each of the Representations being included in an Adaptation Set in the MPD, and

the codec information for each of the Representations, that is included in the scene description file, provides for comparison of the codec information with capability information such that selection of the 3D object content distributed by using the MPEG DASH can be performed without acquiring and analyzing the MPD.

2. The information processing apparatus according to claim 1 , wherein the scene description file stores the codec information in a tracks array of an alternatives array of an MPEG media extension.

3. The information processing apparatus according to claim 1 , wherein the codec information includes information regarding an encoding method, a profile, and a level applied to encoding of the Representations.

4. The information processing apparatus according to claim 3 , wherein

the codec information includes

information regarding the encoding method, the profile, and the level of the Representation of which encoding quality is highest, or

information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest

among all of the Representations included in the Adaptation Set.

5. The information processing apparatus according to claim 3 , wherein

the codec information regarding the encoding includes

information regarding the encoding method, the profile, and the level of the Representation of which encoding quality is highest, and

information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest

among all of the Representations included in the Adaptation Set.

6. The information processing apparatus according to claim 3 , wherein

the codec information includes information regarding the encoding method, the profile, and the level of all of the Representations included in the Adaptation Set.

7. The information processing apparatus according to claim 2 , wherein the scene description file further stores information regarding a profile of the MPEG DASH.

8. The information processing apparatus according to claim 7 , wherein the scene description file stores the information regarding the profile of the MPEG DASH in a mimetype of the alternatives array of the MPEG_media extension.

9. The information processing apparatus according to claim 7 , wherein the scene description file stores the information regarding the profile of the MPEG DASH in a mimetype of a profile_alternatives array of the MPEG media extension.

10. An information processing method comprising:

generating a scene description file that describes a scene of 3D object content, wherein

the scene description file includes information associated with a media presentation description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH), and

the scene description file includes codec information for each of a plurality of Representations, each of the Representations being included in an Adaptation Set in the MPD, and

the codec information for each of the Representations, that is included in the scene description file, provides for comparison of the codec information with capability information such that selection of the 3D object content distributed by using the MPEG DASH can be performed without acquiring and analyzing the MPD.

11. An information processing apparatus comprising:

processing circuitry configured to:

analyze a scene description file that describes a scene of 3D object content,

the scene description file including information associated with a media presentation description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH), and

the scene description file including codec information for each of a plurality of Representations, each of the Representations being included in an Adaptation Set in the MPD;

compare the codec information from the scene description file with capability information of the information processing apparatus;

select the 3D object content distributed by using the MPEG DASH to be decoded on a basis of the comparison without acquiring the MPD; and

decode encoded data of the selected 3D object content.

12. The information processing apparatus according to claim 11 , wherein the codec information is stored in a tracks array of an alternatives array of an MPEG media extension of the scene description file.

13. The information processing apparatus according to claim 11 , wherein

the codec information includes information regarding an encoding method, a profile, and a level applied to the encoding of Representations, and

the processing circuitry is configured to select the 3D object content to be decoded on a basis of the information regarding the encoding method, the profile, and the level.

14. The information processing apparatus according to claim 13 , wherein

the codec information regarding the encoding includes

information regarding the encoding method, the profile, and the level of the Representation of which encoding quality is highest, or

information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest

among all of the Representations included in the Adaptation Set, and

the processing circuitry is configured to select the 3D object content to be decoded on the basis of

the information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is highest, or

the information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest.

15. The information processing apparatus according to claim 13 , wherein

the codec information regarding the encoding includes

information regarding the encoding method, the profile, and the level of the Representation of which encoding quality is highest, and

information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest

among all of the Representations included in the Adaptation Set, and

the processing circuitry is configured to select the 3D object content to be decoded on the basis of

the information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is highest, and

the information regarding the encoding method, the profile, and the level of the Representation of which the encoding quality is lowest.

16. The information processing apparatus according to claim 13 , wherein

the codec information regarding the encoding includes information regarding the encoding method, the profile, and the level of all of the Representations included in the Adaptation Set, and

the processing circuitry is configured to select the 3D object content to be decoded on the basis of the information regarding the encoding method, the profile, and the level of all of the Representations included in the Adaptation Set.

17. The information processing apparatus according to claim 12 , wherein the processing circuitry is configured to select the 3D object content to be decoded further on the basis of information regarding a profile of the MPEG DASH stored in the scene description file.

18. The information processing apparatus according to claim 17 , wherein the processing circuitry is configured to select the 3D object content to be decoded on the basis of the information regarding the profile of the MPEG DASH stored in a mimetype of the alternatives array of the MPEG_media extension of the scene description file.

19. The information processing apparatus according to claim 17 , wherein the processing circuitry is configured to select the 3D object content to be decoded on the basis of the information regarding the profile of the MPEG DASH stored in a mimetype of a profile_alternatives array of the MPEG_media extension of the scene description file.

20. An information processing method comprising:

analyzing a scene description file that describes a scene of 3D object content,

the scene description file including information associated with a media presentation description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH), and

the scene description file including codec information for each of a plurality of Representations, each of the Representations being included in an Adaptation Set in the MPD;

comparing the codec information from the scene description file with capability information of the information processing apparatus;

selecting the 3D object content distributed by using the MPEG DASH to be decoded on a basis of the comparison without acquiring the MPD; and

decoding encoded data of the selected 3D object content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: KIYAMA, YUKA; TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO
To: SONY GROUP CORPORATION
Reel/Frame 062720/0036 →
Continuity (2)
Provisional Application 63084780 · Sep 29, 2020
Related Publication 20230300374A1 · Sep 21, 2023
References Cited (23)
US 6271854B1 · Light · 2001 [cited by examiner]
US 11627314B2 · Tourapis · 2023 [cited by examiner]
US 20160021355A1 · Alpaslan · 2016 [cited by examiner]
US 20170063960A1 · Stockhammer · 2017 [cited by examiner]
US 20170156015A1 · Stockhammer · 2017 [cited by examiner]
US 20170366814A1 · Adsumilli · 2017 [cited by examiner]
US 20180343468A1 · Harrell · 2018 [cited by examiner]
US 20210144190A1 · Amirpour · 2021 [cited by examiner]
US 20210209829A1 · Ilola · 2021 [cited by examiner]
US 20210314626A1 · Kammachi Sreedhar · 2021 [cited by examiner]
US 20210360236A1 · Kirk · 2021 [cited by examiner]
US 20210409818A1 · Bouazizi · 2021 [cited by examiner]
US 20220264080A1 · Harviainen · 2022 [cited by examiner]
US 20220295034A1 · Bouazizi · 2022 [cited by examiner]
WO 2020116154A1 · 2020 [cited by applicant]
WO 2020154206A1 · 2020 [cited by applicant]
WO 2020189038A1 · 2020 [cited by applicant]
International Search Report and Written Opinion mailed on Dec. 7, 2021, received for PCT Application PCT/JP2021/033827, filed on Sep. 15, 2021, 9 pages including English Translation. [cited by applicant]
Bouazizi et al., “[SD] Basic support for Audio in scene description”, Qualcomm Inc., ISO/IEC JTC1/SC29/WG11 MPEG2020/m54852, Aug. 2020, 9 pages. [cited by applicant]
Bhatia et al., “Khronos gITF2.0”, Available Online: https://github.com/KhronosGroup/gITF/tree/master/specification/2.0, Jun. 9, 2017, 111 pages. [cited by applicant]
“Technologies under Considerations on Support of MPEG Media in Scene Descriptions”, N19446, ISO/IEC JTC 1/SC 29/WG 11, Jul. 3, 2020, 27 pages. [cited by applicant]
Shuai Zhao et al: “[SD] on DASH Dynamic Bitrate Adaptation with Viewport Update”, 133. MPEG Meeting; Jan. 11, 2021-Jan. 15, 2021; Online; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m56094 Jan. 6, 2021 … [cited by applicant]
Yuka Kiyama et al: “(39.1) [SD] Improvement on MPEG _media extension”, 132. MPEG Meeting; Oct. 12, 2020-Oct. 16, 2020; Online; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m55044v2, Oct. 14, 2020 (Oct. 1… [cited by applicant]