IP Library Granted Patent US 11,741,575
Granted Patent B2
US 11,741,575 · App. 15/733,894 · Granted Aug 29, 2023

Image processing apparatus and image processing method

Inventors: Koji Yano (Tokyo, JP); Tsuyoshi Kato (Tokyo, JP); Satoru Kuma (Tokyo, JP); Ohji Nakagami (Tokyo, JP)
Assignee: SONY CORPORATION
G06T5/002G06T5/20G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,741,575
App. No.
15/733,894
Filed
Dec 1, 2020
Granted
Aug 29, 2023
Kind
B2
Art Unit
2663
USPC
382/260
Abstract

A filter process is performed on point cloud data using a representative value of the point cloud data for each local region obtained by dividing a three-dimensional space. A two-dimensional plane image on which the point cloud data subjected to the filter process is projected is encoded, and a bitstream is generated. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.

Claims (40)

1. An image processing apparatus comprising:

circuitry configured to:

divide a three-dimensional space containing point cloud data into a plurality of grids;

derive, for the grids, respective representative values of the point cloud data;

perform a filter process on the point cloud data by performing trilinear smoothing of the respective representative values of the grid; and

encode a two-dimensional plane image on which the point cloud data subjected to the filter process, and generate a bitstream related to the encoded two-dimensional plane image.

2. The image processing apparatus according to claim 1 , wherein

the grids each have a cube shape having a predetermined size.

3. The image processing apparatus according to claim 1 , wherein

the grids each have a rectangular parallelepiped shape having a predetermined size.

4. The image processing apparatus according to claim 1 , wherein

the circuitry is configured to generate the bitstream including information regarding at least one of a size or a shape of each grid.

5. The image processing apparatus according to claim 1 , wherein

each of the respective representative values includes an average of the point cloud data contained in a corresponding one of the grids.

6. The image processing apparatus according to claim 1 , wherein

each of the respective representative values includes a median of the point cloud data contained in a corresponding one of the grids.

7. The image processing apparatus according to claim 1 , wherein

the circuitry is configured to perform the trilinear smoothing on geometry information on points of the point cloud data.

8. The image processing apparatus according to claim 1 , wherein

the circuitry is configured to perform the trilinear smoothing on attribute information on points of the point cloud data.

9. The image processing apparatus according to claim 1 , wherein

the circuitry performs the filter process on a point of the point cloud data corresponding to an end portion of a patch included in the two-dimensional plane image.

10. An image processing method performed by an electronic device, the method comprising:

dividing a three-dimensional space containing point cloud data into a plurality of grids;

deriving, for the grids, respective representative values of the point cloud data;

performing a filter process on the point cloud data by performing trilinear smoothing of the respective representative values of the grid; and

encoding a two-dimensional plane image on which the point cloud data subjected to the filter process, and generate a bitstream related to the encoded two-dimensional plane image.

11. An image processing apparatus comprising:

circuitry configured to: therefor

decode a bitstream and generate coded data of a two-dimensional plane image on which point cloud data is projected;

reconstruct the point cloud data from the two-dimensional plane image;

divide three-dimensional space containing the reconstructed point cloud data into a plurality of grids;

derive, for the grids, respective representative values of the reconstructed point cloud data; and

perform a filter process on the reconstructed point cloud data by performing trilinear smoothing of the respective representative values of the grids.

12. An image processing method performed by an electronic device, the method comprising:

decoding a bitstream and generate coded data of a two-dimensional plane image on which point cloud data is projected;

reconstructing the point cloud data from the two-dimensional plane image;

dividing three-dimensional space containing the reconstructed point cloud data into a plurality of grids;

deriving, for the grids, respective representative values of the reconstructed point cloud data; and

performing a filter process on the reconstructed point cloud data by performing trilinear smoothing of the respective representative values of the grids.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2020
From: YANO, KOJI; KATO, TSUYOSHI; KUMA, SATORU; NAKAGAMI, OHJI
To: SONY CORPORATION
Reel/Frame 054497/0986 →
Priority Claims (1)
JP 2018-131295 · Jul 11, 2018 · national
Continuity (1)
Related Publication 20210217139A1 · Jul 15, 2021