IP Library Granted Patent US 12,217,464
Granted Patent B2
US 12,217,464 · App. 17/421,704 · Granted Feb 4, 2025

Three-dimensional data encoding method and device, and three-dimensional data decoding method and device

Inventors: Youngho Oh (Suwon-si, KR); Jihwan Woo (Suwon-si, KR); Sungryeul Rhyu (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T9/001G06T3/40G06T9/00G06T17/00G06T17/20H04N19/117H04N19/44H04N19/463
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,464
App. No.
17/421,704
Granted
Feb 4, 2025
Kind
B2
Abstract

Provided is a method of processing and transmitting three-dimensional data represented as a point cloud. The method of encoding three-dimensional (3D) data includes: generating a geometry image indicating position information of points, a texture image indicating color information of the points, and an occupancy map indicating occupancy information of the position information of the points in the geometry image, by projecting the points included in the 3D data onto a two-dimensional (2D) plane; generating a filtered occupancy map by performing filtering on the occupancy map; performing image padding on the geometry image and the texture image, based on the filtered occupancy map; and generating and outputting a bitstream including a padded geometry image, a padded texture image, a downsampled occupancy map, and information about the filtering performed on the occupancy map.

Claims (37)

1. A method of encoding three-dimensional (3D) data, the method comprising:

generating a geometry image indicating position information of points included in the 3D data, a texture image indicating color information of the points, and an occupancy map indicating occupancy information of the position information of the points in the geometry image, by projecting the points included in the 3D data onto a two-dimensional (2D) plane;

generating a filtered occupancy map by performing filtering on the occupancy map;

performing image padding on the geometry image and the texture image, based on the filtered occupancy map; and

generating and outputting a bitstream including a padded geometry image, a padded texture image, a downsampled occupancy map, and information about the filtering performed on the occupancy map.

2. The method of claim 1 , wherein the generating of the occupancy map comprises downsampling an occupancy map based on an occupancy precision value N.

3. The method of claim 2 , wherein, in the downsampling, when there is a projected point in a predetermined N*N pixel block, an entire area of the predetermined N*N pixel block of the occupancy map is filled with 1.

4. The method of claim 1 , wherein the generating of the filtered occupancy map comprises upsampling the occupancy map based on an occupancy precision value N.

5. The method of claim 4 , wherein the generating of the filtered occupancy map further comprises performing 2D filtering on the upsampled occupancy map.

6. The method of claim 5 , wherein, in the generating of the filtered occupancy map, whether to perform the 2D filtering is determined based on at least one of a size of an occupancy map patch or a number of 1's included in the occupancy map patch.

7. The method of claim 1 , wherein the filtered occupancy map is generated in units of patches.

8. A computer program product comprising one or more non-transitory computer readable recording media having stored therein a program that, when executed by a processor, performs the method of claim 1 .

9. An apparatus for encoding three-dimensional (3D) data, the apparatus comprising:

a memory;

a communicator; and

at least one processor,

wherein the at least one processor is configured to:

generate a geometry image indicating position information of points included in the 3D data, a texture image indicating color information of the points, and an occupancy map indicating occupancy information of the position information of the points in the geometry image, by projecting the points included in the 3D data onto a two-dimensional (2D) plane;

generate a filtered occupancy map by performing filtering on the occupancy map;

perform image padding on the geometry image and the texture image, based on the filtered occupancy map; and

generate and output a bitstream including a padded geometry image, a padded texture image, a downsampled occupancy map, and information about the filtering performed on the occupancy map.

10. A method of decoding three-dimensional (3D) data, the method comprising:

receiving a bitstream;

obtaining, from the bitstream, a texture image, a geometry image, an occupancy map, and filtering information;

generating a filtered occupancy map by performing filtering on the occupancy map, based on the filtering information, wherein the filtering comprises at least one of upsampling or downsampling;

reconstructing position information of points based on the geometry image and the filtered occupancy map; and

reconstructing 3D data by reconstructing color information of points with reconstructed position information, based on the texture image.

11. An apparatus for decoding three-dimensional (3D) data, the apparatus comprising:

a memory;

a communicator; and

at least one processor,

wherein the at least one processor is configured to:

receive a bitstream;

obtain, from the bitstream, a texture image, a geometry image, an occupancy map, and filtering information,

generate a filtered occupancy map by performing filtering on the occupancy map based on the filtering information, wherein the filtering comprises at least one of upsampling or downsampling;

reconstruct position information of points based on the geometry image and the filtered occupancy map, and

reconstruct 3D data by reconstructing color information of points with reconstructed position information, based on the texture image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2021
From: OH, YOUNGHO; WOO, JIHWAN; RHYU, SUNGRYEUL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 056797/0159 →
Priority Claims (1)
KR 10-2019-0003953 · Jan 11, 2019 · national
Continuity (1)
Related Publication 20220084254A1 · Mar 17, 2022
References Cited (29)
US 8290305B2 · Minear et al. · 2012 [cited by applicant]
US 9811880B2 · Mundhenk et al. · 2017 [cited by applicant]
US 11523135B2 · Aflaki Beni · 2022 [cited by examiner]
US 11747823B2 · Zhang et al. · 2023 [cited by applicant]
US 11915390B2 · Kuma · 2024 [cited by examiner]
US 20180173239A1 · Yoon et al. · 2018 [cited by applicant]
US 20180268570A1 · Budagavi et al. · 2018 [cited by applicant]
US 20180324240A1 · Fleureau et al. · 2018 [cited by applicant]
US 20200021847A1 · Kim · 2020 [cited by examiner]
US 20210074030A1 · Oh et al. · 2021 [cited by applicant]
US 20210183109A1 · Chevet · 2021 [cited by examiner]
US 20210185331A1 · Mammou · 2021 [cited by examiner]
US 20210358176A1 · Kuma · 2021 [cited by examiner]
CN 102317972A · 2012 [cited by applicant]
CN 109084746A · 2018 [cited by applicant]
KR 1020140060454A · 2014 [cited by applicant]
KR 1020180071928A · 2018 [cited by applicant]
KR 1020180122947A · 2018 [cited by applicant]
KR 1020190118926A · 2019 [cited by applicant]
3DG, “PCC Test Model Category 2 v0”, Oct. 2017, ISO/IEC JTC1/SC29/WG11 N17248, 11 pages. [cited by applicant]
Supplementary European Search Report dated Apr. 28, 2022 in connection with European Patent Application No. 20 73 8151, 12 pages. [cited by applicant]
Korean Intellectual Property Office, “Office Action,” issued May 15, 2023, in connection with Korean Patent Application No. 10-2019-0003953, 6 pages. [cited by applicant]
European Patent Office, “Communication under Rule 71(3) EPC,” dated Jun. 6, 2023, in connection with European Patent Application No. 20738151.8, 43 pages. [cited by applicant]
Guede et al., “PCC new proposal: Improve point cloud compression through occupancy map refinement,” Document ISO/IEC JTC1/SC29/WG11 MPEG2018/m44779, Oct. 2018, 7 pages. [cited by applicant]
Eurico Manuel Rodrigues Lopes, “Adaptive Plane Projection for Video-based Point Cloud Coding”, Tecnico Lisboa, Thesis to obtain the Masters of Science Degree in Electrical and Computer Engineering, Nov. 2018, 114 pages. [cited by applicant]
International Search Report dated May 14, 2020 in connection with International Patent Application No. PCT/KR2020/000595, 2 pages. [cited by applicant]
Written Opinion of the International Searching Authority dated May 14, 2020 in connection with International Patent Application No. PCT/KR2020/000595, 3 pages. [cited by applicant]
Office Action issued Jun. 28, 2024, in connection with Chinese Patent Application No. 202080013718.8, 12 pages. [cited by applicant]
Notice of Allowance issued Dec. 17, 2024, in connection with Chinese Patent Application No. 202080013718.8, 7 pages. [cited by applicant]