IP Library › Granted Patent US 11,825,135
Granted Patent B2
US 11,825,135 · App. 17/431,720 · Granted Nov 21, 2023

Information processing apparatus, information processing method, reproduction processing apparatus, and reproduction processing method

Inventors: Mitsuru Katsumata (Tokyo, JP); Ryohei Takahashi (Tokyo, JP); Mitsuhiro Hirabayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N21/234
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,825,135
App. No.
17/431,720
Granted
Nov 21, 2023
Kind
B2
Abstract

To provide an information processing apparatus, an information processing method, a reproduction processing apparatus, and a reproduction processing method that provide a user with a viewing experience with a high degree of freedom. A data input unit acquires data of a three-dimensional space configured as a single spatial three-dimensional object including a plurality of three-dimensional objects. A preprocessing unit generates three-dimensional object-specifying information for identifying a specific three-dimensional object included in a three-dimensional space. A file generation unit generates a file including data of a three-dimensional space and three-dimensional object-specifying information generated by the preprocessing unit.

Claims (46)

1. An information processing apparatus comprising:

preprocessing circuitry configured to generate object-specifying information for identifying a specific object included in a three-dimensional space in a spatial three-dimensional object constituting the three-dimensional space with a plurality of objects as a single three-dimensional object; and

file generation circuitry configured to generate a file including data of the spatial three-dimensional object and the object-specifying information, wherein

the object-specifying information includes identification information, position information, and detailed information of a same object,

the preprocessing circuitry is further configured to store the object-specifying information in any of a node in a scene description, a user description, or a unique description, and

under a condition where the position information of the specific object changes with time, the file generation circuitry is further configured to generate as a scene description file the scene description in which the object-specifying information is stored simultaneously with position information of the spatial three-dimensional object by the preprocessing circuitry.

2. The information processing apparatus according to claim 1 , wherein

the file generation circuitry is further configured to store a description in which the object-specifying information is stored by the preprocessing circuitry or access information to the description in ISO Base Media File Format (ISOBMFF) or either one or both of a scene description or AdaptationSet corresponding to the specific object of Media Presentation Description (MPD).

3. The information processing apparatus according to claim 1 , wherein

the preprocessing circuitry is further configured to generate noticeable object information including identification information of a particular noticeable object among the objects and noticeability information of the noticeable object.

4. The information processing apparatus according to claim 3 , wherein

the preprocessing circuitry is further configured to store the noticeable object information in any of a scene description, a user description, or a unique description.

5. The information processing apparatus according to claim 4 , wherein

the file generation circuitry is further configured to store a description in which the noticeable object information is stored by the preprocessing circuitry or access information to the description in either one or both of ISOBMFF or AdaptationSet of MPD.

6. An information processing apparatus comprising:

preprocessing circuitry configured to generate object-specifying information for identifying a specific object included in a three-dimensional space in a spatial three-dimensional object constituting the three-dimensional space with a plurality of objects as a single three-dimensional object; and

file generation circuitry configured to generate a file including data of the spatial three-dimensional object and the object-specifying information, wherein

the preprocessing circuitry is further configured to generate high-definition object-specifying information including information for specifying a high-definition object having high definition among the objects and definition of the high-definition object, to generate high-definition data of the high-definition object and basic data excluding the high-definition object from the three-dimensional space, and to generate information for specifying the high-definition data and the basic data.

7. The information processing apparatus according to claim 6 , wherein

the preprocessing circuitry is further configured to store the high-definition object-specifying information in any of a scene description, a user description, or a unique description.

8. The information processing apparatus according to claim 7 , wherein

the file generation circuitry is further configured to store a description in which the high-definition object-specifying information is stored by the preprocessing circuitry or access information to the description in either one or both of ISOBMFF or AdaptationSet of MPD.

9. The information processing apparatus according to claim 6 , wherein

the preprocessing circuitry is further configured to generate difference data for making the high-definition object high-definition and to generate information for specifying the difference data.

10. The information processing apparatus according to claim 6 , wherein

the preprocessing is further configured to generate information for specifying a partial object included in each of the objects included in the three-dimensional object, and to store the information for specifying the partial object included in each of the objects in either one or both of a scene description or AdaptationSet of MPD.

11. An information processing method executed by a computer, the method comprising:

in a spatial three-dimensional object that constitutes a three-dimensional space with a plurality of objects as a single three-dimensional object, generating object-specifying information for identifying a specific object included in the three-dimensional space, wherein the object-specifying information includes identification information, position information, and detailed information of a same object;

generating a file including data of the spatial three-dimensional object and the object-specifying information;

storing the object-specifying information in any of a node in a scene description, a user description, or a unique description; and

under a condition where the position information of the specific object changes with time, generating as a scene description file the scene description in which the object-specifying information is stored simultaneously with position information of the spatial three-dimensional object by the preprocessing circuitry.

12. A reproduction processing apparatus comprising:

reception circuitry configured to receive a file including content of a spatial three-dimensional object that constitutes a three-dimensional space with a plurality of objects as a single three-dimensional object, and object-specifying information for identifying a specific object included in the spatial three-dimensional object, wherein

the object-specifying information includes identification information, position information, and detailed information of a same object,

the object-specifying information is stored in any of a node in a scene description, a user description, or a unique description, and

under a condition where the position information of the specific object changes with time, the scene description in which the object-specifying information is stored simultaneously with position information of the spatial three-dimensional object is generated as a scene description file;

information processing circuitry configured to acquire the object-specifying information from the file received by the reception circuitry and to specify the specific object from the spatial three-dimensional object on the basis of the acquired object-specifying information; and

reproduction circuitry configured to reproduce the content on the basis of a specifying result by the information processing circuitry.

13. A reproduction processing method executed by a computer, the method comprising:

receiving a file including content of a spatial three-dimensional object that constitutes a three-dimensional space with a plurality of objects as a single three-dimensional object, and object-specifying information for identifying a specific object included in the spatial three-dimensional object, wherein

the object-specifying information includes identification information, position information, and detailed information of a same object,

the object-specifying information is stored in any of a node in a scene description, a user description, or a unique description, and

under a condition where the position information of the specific object changes with time, the scene description in which the object-specifying information is stored simultaneously with position information of the spatial three-dimensional object is generated as a scene description file;

acquiring the object-specifying information from the received file;

specifying the specific object from the three-dimensional space on the basis of the acquired object-specifying information; and

reproducing the content on the basis of a specifying result.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2026
From: SONY GROUP CORPORATION
To: META PLATFORMS, INC.
Reel/Frame 076071/0572 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2021
From: KATSUMATA, MITSURU; TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO
To: SONY GROUP CORPORATION
Reel/Frame 057210/0476 →
Continuity (3)
Provisional Application 62866334 · Jun 25, 2019
Provisional Application 62821047 · Mar 20, 2019
Related Publication 20220159316A1 · May 19, 2022