IP Library Granted Patent US 11,657,539
Granted Patent B2
US 11,657,539 · App. 16/754,746 · Granted May 23, 2023

Information processing apparatus and information processing method

Inventors: Ohji Nakagami (Tokyo, JP); Koji Yano (Tokyo, JP); Satoru Kuma (Tokyo, JP); Tsuyoshi Kato (Kanagawa, JP)
Assignee: SONY CORPORATION
G06T9/00G06T3/4092G06T17/10H04L65/70H04L65/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,657,539
App. No.
16/754,746
Filed
Apr 9, 2020
Granted
May 23, 2023
Kind
B2
Art Unit
2649
USPC
382/232
Abstract

3D data representing a three-dimensional structure is divided into a plurality of pieces and encoded, an obtained plurality of divided bitstreams is multiplexed, and one bitstream including a separator indicating a position of a joint between the divided bitstreams is generated. Furthermore, a separator indicating a position of a joint between divided bitstreams obtained by dividing 3D data representing a three-dimensional structure into a plurality of pieces and encoding the plurality of divided pieces of the 3D data, which is included in a bitstream obtained by multiplexing a plurality of the divided bitstreams, is analyzed, and the bitstream is divided into every divided bitstream on the basis of information included in the analyzed separator, and decoded. Applications of the technology include being implemented in, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.

Claims (58)

1. An information processing apparatus comprising:

circuitry configured to

divide octree data representing a three-dimensional structure into a first hierarchy and a second hierarchy to encode the first hierarchy and the second hierarchy into a first divided bitstream and a second divided bitstream, respectively, wherein a first resolution of the first hierarchy is different from a second resolution of the second hierarchy, the first hierarchy corresponds to a first level of the octree, and the second hierarchy corresponds to a second level of the octree, and

generate one bitstream comprising the first divided bitstream, a separator, and the second divided bitstream,

wherein the separator is between the first divided bitstream and the second divided bitstream, and the separator has a unique bit pattern for detecting the separator.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to

arrange the separator at a joint between the first divided bitstream and the second divided bitstream.

3. The information processing apparatus according to claim 2 , wherein the circuitry is further configured to

generate the separator, and arrange the separator at the joint between the first divided bitstream and the second divided bitstream.

4. The information processing apparatus according to claim 1 , wherein the separator further comprises position information indicating a position of a part of the three-dimensional structure of the octree data corresponding to the divided bitstream.

5. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to

generate the first divided bitstream and the second divided bitstream by converting the octree data into 2D data representing a two-dimensional structure, and dividing and encoding the 2D data on a basis of the two-dimensional structure.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to

generate the first divided bitstream and the second divided bitstream by dividing the octree data on a basis of the three-dimensional structure to convert each of the obtained plurality of pieces of divided octree data into divided 2D data representing a two-dimensional structure, and encoding each of the obtained plurality of pieces of the divided 2D data.

7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to

divide the octree data into geometry data indicating a position of each point of a point cloud and attribute data indicating attribute information on each point of the point cloud to encode the divided data, and generate the first divided bitstream and the second divided bitstream.

8. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

generate a third divided bitstream by encoding first attribute data of the first hierarchy, and generate a fourth divided bitstream by encoding second attribute data of the second hierarchy;

include the third divided bitstream, a second separator, and the fourth divided bitstream in the one bitstream,

wherein the second separator is between the third divided bitstream and the fourth divided bitstream.

9. An information processing method comprising:

dividing octree data representing a three-dimensional structure into a first hierarchy and a second hierarchy to encode the first hierarchy and the second hierarchy into a first divided bitstream and a second divided bitstream, respectively, wherein a first resolution of the first hierarchy is different from a second resolution of the second hierarchy, the first hierarchy corresponds to a first level of the octree, and the second hierarchy corresponds to a second level of the octree, and

generating one bitstream comprising the first divided bitstream, a separator, and the second divided bitstream,

wherein the separator is between the first divided bitstream and the second divided bitstream, and the separator has a unique bit pattern for detecting the separator.

10. An information processing apparatus comprising:

circuitry configured to

analyze a separator indicating a position of a joint between a first divided bitstream and a second divided bitstream obtained by dividing octree data representing a three-dimensional structure into a first hierarchy and a second hierarchy and encoding the first hierarchy and the second hierarchy into the first divided bitstream and the second divided bitstream, the separator being included in a bitstream comprising the first divided bitstream, the separator, and the second divided bitstream; and

divide the bitstream into the first divided bitstream and the second divided bitstream on a basis of information included in the separator analyzed by the analysis unit, to decode each of the plurality of divided bitstreams,

wherein a first resolution of the first hierarchy is different from a second resolution of the second hierarchy, the first hierarchy corresponds to a first level of the octree, and the second hierarchy corresponds to a second level of the octree, and

wherein the separator is between the first divided bitstream and the second divided bitstream, and the separator has a unique bit pattern for detecting the separator.

11. The information processing apparatus according to claim 10 , wherein the circuitry is further configured to

detect the separator by detecting the bit pattern, and

divide the bitstream at a detected position of the separator.

12. The information processing apparatus according to claim 11 , wherein

the separator further includes information regarding a particular divided bitstream of t the first divided bitstream and the second divided bitstream corresponding to the separator, and

the circuitry is configured to analyze the separator to obtain the information regarding the particular divided bitstream.

13. The information processing apparatus according to claim 12 , wherein the circuitry is further configured to

synthesize a plurality of pieces of divided data obtained by decoding each of the first divided bitstream and the second divided bitstream, on a basis of the information regarding the particular divided bitstream obtained by analyzing the separator.

14. The information processing apparatus according to claim 13 , wherein

the information regarding the particular divided bitstream includes position information indicating a position of a part of the three-dimensional structure of the octree data corresponding to the particular divided bitstream, and

the circuitry is further configured to synthesize the plurality of pieces of divided data on a basis of the position information obtained by analyzing the separator.

15. The information processing apparatus according to claim 14 , wherein

the position information includes information indicating a position of a part of the three-dimensional structure of the octree data corresponding to the particular divided bitstream in a two-dimensional structure, and

the circuitry is further configured to synthesize a plurality of pieces of divided 2D data representing a two-dimensional structure obtained by decoding each of the first divided bitstream and the second divided bitstream, on a basis of position information obtained by analyzing the separator.

16. The information processing apparatus according to claim 14 , wherein

the position information includes information indicating a position of a part of the three-dimensional structure of the 3D data corresponding to the particular divided bitstream in the three-dimensional structure, and

the circuitry is further configured to synthesize a plurality of divided octree data obtained by decoding each of the first divided bitstream and the second divided bitstream, on a basis of the position information obtained by analyzing the separator.

17. The information processing apparatus according to claim 13 , wherein

the information regarding the particular divided bitstream includes information regarding an attribute of the particular divided bitstream, and

the circuitry is further configured to synthesize geometry data indicating a position of each point of a point cloud, attribute data indicating attribute information on each point of the point cloud, obtained by decoding each of the first divided bitstream and the second divided bitstream, on a basis of the information regarding the attribute obtained by analyzing the separator.

18. The information processing apparatus according to claim 13 , wherein

the information regarding the particular divided bitstream includes information regarding a resolution corresponding to the particular divided bitstream, and

the circuitry is further configured to synthesize a plurality of pieces of divided data obtained by decoding each of the first divided bitstream and the second divided bitstream, on a basis of the information regarding the resolution obtained by analyzing the separator.

19. An information processing method comprising:

analyzing a separator indicating a position of a joint between a first divided bitstream and a second divided bitstream obtained by dividing octree data representing a three-dimensional structure into a first hierarchy and a second hierarchy and encoding the first hierarchy and the second hierarchy into the first divided bitstream and the second divided bitstream, the separator being included in a bitstream comprising the first divided bitstream, the separator, and the second divided bitstream; and

dividing the bitstream into the first divided bitstream and the second divided bitstream on a basis of information included in the analyzed separator to decode each of the plurality of divided bitstreams,

wherein a first resolution of the first hierarchy is different from a second resolution of the second hierarchy, the first hierarchy corresponds to a first level of the octree, and the second hierarchy corresponds to a second level of the octree, and

wherein the separator is between the first divided bitstream and the second divided bitstream, and the separator has a unique bit pattern for detecting the separator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2020
From: NAKAGAMI, OHJI; YANO, KOJI; KUMA, SATORU; KATO, TSUYOSHI
To: SONY CORPORATION
Reel/Frame 053344/0103 →
Priority Claims (1)
JP JP2017-200585 · Oct 16, 2017 · national
Continuity (1)
Related Publication 20200320744A1 · Oct 8, 2020
Cited By (1)
US 12,322,144