IP Library › Granted Patent US 11,721,048
Granted Patent B2
US 11,721,048 · App. 16/960,910 · Granted Aug 8, 2023

Image processing apparatus and method

Inventors: Ohji Nakagami (Tokyo, JP); Koji Yano (Tokyo, JP); Satoru Kuma (Tokyo, JP); Tsuyoshi Kato (Kanagawa, JP)
Assignee: SONY CORPORATION
G06T11/003G06T7/50G06T9/00G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,048
App. No.
16/960,910
Granted
Aug 8, 2023
Kind
B2
Abstract

The present disclosure relates to an imaging processing apparatus and method by which degradation of the quality due to two-dimensional projection of 3D data can be suppressed. All pieces of data for each position included in 3D data representative of a three-dimensional structure are projected to a two-dimensional plane of plural layers. Further, all pieces of data for each position of 3D data projected to a two-dimensional plane having the number of layers indicated by layer number information are projected to a three-dimensional space. The present disclosure can be applied, for example, to an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, and a program.

Claims (48)

1. An image encoding apparatus, comprising:

circuitry configured to:

define a bounding box containing 3D data;

project positional data of the 3D data to at least three 2D layers in a depthwise direction of the bounding box, wherein depth values of the 2D layers are different from each other in the depthwise direction;

encode the projected positional data; and

generate a bit stream including the encoded positional data and signal information representing the number of the 2D layers.

2. The image encoding apparatus according to claim 1 , wherein

the 3D data includes at least three overlapping points that are projected to the respective 2D layers different from each other and each have a same positional data viewed from the depthwise direction.

3. The image encoding processing apparatus according to claim 2 , wherein

the circuitry is further configured to generate a same number of the 2D layers as a maximum number of overlap among the overlapping points.

4. The image encoding apparatus according to claim 1 , wherein

the circuitry is further configured to set a fixed value to a position of at least one of the 2D layers where no positional data is projected.

5. The image encoding apparatus according to claim 1 , wherein

the circuitry is further configured to set, to a position of at least one of the 2D layers where no positional data is projected, a value higher than a maximum value of a depth of the 3D data.

6. The image encoding apparatus according to claim 1 , wherein

the circuitry is configured to project the positional data of 3D data to the 2D layers on a basis of a depth parameter indicating a range with respect to each of the 2D layers in the depthwise direction where the projection of the positional data is allowed.

7. The image encoding apparatus according to claim 1 , wherein

the 3D data includes point cloud data where each point is represented by position information and attribute information.

8. An image encoding method, comprising:

defining a bounding box containing 3D data;

projecting positional data of the 3D data to at least three 2D layers in a depthwise direction of the bounding box, wherein depth values of the 2D layers are different from each other in the depthwise direction;

encoding the projected positional data; and

generating a bit stream including the encoded positional data and signal information representing the number of the 2D layers.

9. An image decoding apparatus, comprising:

circuitry configured to:

decode, from a bitstream, signal information representing a number of 2D layers,

wherein the 2D layers are defined to a bounding box defined to reconstruct 3D data, and

wherein depth values of the 2D layers are different from each other in a depthwise direction of the bounding box;

decode, from the bitstream, encoded positional data to acquire geometry images representing the 3D data,

wherein each of the geometry images represents a corresponding one of the 2D layers to which the 3D data is projected,

wherein the number of geometry images is equal to the number of the 2D layers; and

construct, based on the signal information, the 3D data by projecting each of the geometry images in a three dimensional space in the depthwise direction.

10. The image decoding apparatus according to claim 9 , wherein

the circuitry is configured to construct the 3D data by projecting each of the geometry images in the three dimensional space in the depthwise direction using data other than data of the geometry images having a fixed value representing no positional data.

11. The image decoding apparatus according to claim 9 , wherein

the circuitry is configured to construct the 3D data by projecting each of the geometry images in the three dimensional space in the depthwise direction using data other than data of the geometry images having a value higher than a maximum value of a depth of the 3D data.

12. The image decoding apparatus according to claim 9 , wherein

the circuitry is configured to construct the 3D data by projecting each of the geometry images on a basis of a depth parameter indicating a range in the three dimensional space in the depthwise direction where the projection of the positional data is allowed.

13. The image decoding apparatus according to claim 9 , wherein

the 3D data includes point cloud data where each point of the point cloud data is represented by position information and attribute information.

14. An image decoding method, comprising:

decoding, from a bitstream, signal information representing the number of 2D layers,

wherein the 2D layers are defined to a bounding box defined to reconstruct 3D data, and

wherein depth values of the 2D layers are different from each other in a depthwise direction of the bounding box;

decoding, from the bitstream, encoded positional data to acquire geometry images representing the 3D data,

wherein the number of geometry images is equal to the number of the 2D layers;

projecting, based on the signal information, each of the geometry images to a corresponding one of the 2D layers in the depthwise direction; and

reconstructing the 3D data based on the projected geometry images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2020
From: NAKAGAMI, OHJI; YANO, KOJI; KUMA, SATORU; KATO, TSUYOSHI
To: SONY CORPORATION
Reel/Frame 053597/0517 →
Priority Claims (1)
JP 2018-004983 · Jan 16, 2018 · national
Continuity (1)
Related Publication 20210174559A1 · Jun 10, 2021