IP Library Granted Patent US 11,948,337
Granted Patent B2
US 11,948,337 · App. 17/278,004 · Granted Apr 2, 2024

Image processing apparatus and method

Inventors: Satoru Kuma (Tokyo, JP); Ohji Nakagami (Tokyo, JP); Hiroyuki Yasuda (Tokyo, JP); Koji Yano (Tokyo, JP); Tsuyoshi Kato (Tokyo, JP)
Assignee: SONY CORPORATION
G06T9/001G06T3/0031G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,948,337
App. No.
17/278,004
Granted
Apr 2, 2024
Kind
B2
Abstract

The present disclosure relates to image processing apparatus and method that can prevent a reduction in image quality. Geometry data that is a frame image having arranged thereon a projected image obtained by projecting 3D data representing a three-dimensional structure on a two-dimensional plane and includes a special value indicating occupancy map information in a range is generated. The generated geometry data is encoded. Further, the encoded data on the geometry data is decoded, and a depth value indicating a position of the 3D data and the occupancy map information are extracted from the decoded geometry data. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, or a program.

Claims (46)

1. An image processing apparatus comprising:

circuitry configured to:

project 3D data representing a three-dimensional structure on a two-dimensional plane to obtain a projected image;

generate geometry data including

a frame image on which the projected image is arranged, and

a special value indicating first occupancy map information in a range; and

encode the geometry data.

2. The image processing apparatus according to claim 1 , wherein the special value indicates that the projected image is not present.

3. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

set the special value in the range of the geometry data; and

generate the geometry data including the special value in the range.

4. The image processing apparatus according to claim 3 , wherein the circuitry is further configured to set, as the special value, at least one of a minimum value, a maximum value, or an intermediate value of the range of the geometry data.

5. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

set a margin having a predetermined width between a range indicating a depth value indicating a position of the 3D data and the special value in the range of the geometry data; and

generate the geometry data including the special value and the margin in the range.

6. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to set a threshold for identifying a depth value indicating a position of the 3D data and the special value.

7. The image processing apparatus according to claim 6 , wherein the circuitry is further configured to:

decode the encoded geometry data; and

set the threshold based on the decoded geometry data.

8. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to correct a range of a depth value indicating a position of the 3D data to generate the geometry data including the special value in the corrected range.

9. The image processing apparatus according to claim 8 , wherein the circuitry is further configured to quantize or shift the depth value to correct the range of the depth value.

10. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to generate a bitstream including the encoded geometry data and a parameter associated with the special value.

11. The image processing apparatus according to claim 10 , wherein the parameter includes at least one of information indicating the special value, information indicating a margin between a range indicating a depth value indicating a position of the 3D data and the special value, or information indicating a threshold for identifying the depth value and the special value.

12. The image processing apparatus according to claim 10 , wherein the circuitry is further configured to generate the bitstream including the parameter in units of patches, frames, or sequences.

13. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to generate geometry data including the special value in a range of data in a certain region satisfying a predetermined condition of the frame image.

14. The image processing apparatus according to claim 13 , wherein the circuitry is further configured to generate the geometry data including the special value in a range of data in a region based on second occupancy map information having a resolution lower than that of the first occupancy map information of the geometry data.

15. An image processing method, comprising:

projecting 3D data representing a three-dimensional structure on a two-dimensional plane to obtain a projected image;

generating geometry data including

a frame image on which the projected image is arranged, and

a special value indicating occupancy map information in a range; and

encoding the geometry data.

16. An image processing apparatus, comprising:

circuitry configured to:

decode encoded data on geometry data including

a frame image on which a projected image of 3D data on a two-dimensional plane is arranged, the 3D data representing a three-dimensional structure, and

a special value indicating first occupancy map information in a range; and

extract, from the geometry data, a depth value indicating a position of the 3D data and the first occupancy map information.

17. The image processing apparatus according to claim 16 , wherein the circuitry is further configured to extract the depth value and the special value, based on a parameter associated with the special value.

18. The image processing apparatus according to claim 16 , wherein the circuitry is further configured to correct a range of the depth value.

19. The image processing apparatus according to claim 16 , wherein the circuitry is further configured to synthesize the first occupancy map information and second occupancy map information having a resolution lower than that of the first occupancy map information.

20. An image processing method, comprising:

decoding encoded data on geometry data including

a frame image on which a projected image of 3D data on a two-dimensional plane is arranged, the 3D data representing a three-dimensional structure, and

a special value indicating occupancy map information in a range; and

extracting, from the geometry data, a depth value indicating a position of the 3D data and the occupancy map information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2021
From: KUMA, SATORU; NAKAGAMI, OHJI; YASUDA, HIROYUKI; YANO, KOJI; KATO, TSUYOSHI
To: SONY CORPORATION
Reel/Frame 055652/0868 →
Priority Claims (1)
JP 2018-186368 · Oct 1, 2018 · national
Continuity (1)
Related Publication 20210358176A1 · Nov 18, 2021