IP Library › Granted Patent US 12,707,084
Granted Patent B2
US 12,707,084 · App. 18/383,489 · Granted Aug 11, 2026

Method and device for coding the geometry of a point cloud

Inventors: Celine Guede (Cesson-Sevigne, FR); Joan Llach Pinsach (Cesson-Sevigne, FR); Kangying Cai (Rennes, FR)
Assignee: InterDigital VC Holdings, Inc.
H04N19/597H04N19/103H04N19/147H04N19/17
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,707,084
App. No.
18/383,489
Filed
Oct 25, 2023
Granted
Aug 11, 2026
Kind
B2
Art Unit
2486
USPC
375/240.12
Abstract

The present principles relate to a method and device method for encoding depth values of orthogonally projected points of a point cloud onto a projection plane. The present principles also relate to a method and device for decoding a point cloud, a computer readable program and a video signal.

Claims (37)

1 . A method of reconstructing geometry of a point cloud, comprising:

decoding from a bitstream a first depth image of one or more depth images, the one or more depth images representing different depth values of orthogonally projected points of the point cloud onto a projection plane;

decoding, from a SPS message or a PPS message in the bitstream, a depth coding mode associated with a second depth image of the one or more depth images, the depth coding mode indicating whether the second depth image is encoded or not in the bitstream;

obtaining a first depth value for at least one first pixel of the first depth image; and

responsive to the depth coding mode, determining a second depth value for at least one second pixel of the second depth image, the at least one second pixel being co-located to the at least one first pixel, the second depth value being determined from the first depth value of the at least one first pixel and a first depth value of at least one neighboring pixel of the at least one first pixel in the first depth image;

wherein the at least one neighboring pixel is obtained responsive to a determination that a spatial distance between the at least one first pixel in the first depth image and the at least one neighboring pixel is below a given threshold.

2 . The method of claim 1 , wherein the second depth value is determined as an average of the first depth value of the at least one neighboring pixel.

3 . The method of claim 1 , wherein the second depth value is determined as a maximum first depth value of the at least one neighboring pixel.

4 . The method of claim 1 , wherein the second depth value is determined as a minimum first depth value of the at least one neighboring pixel.

5 . The method of claim 1 , further comprising de-projecting the first depth image and the second depth image.

6 . The method of claim 1 , wherein the depth coding mode is encoded as a metadata associated with a reconstruction of the point cloud whose geometry is represented by the one or more depth images.

7 . The method of claim 1 , wherein if the depth coding mode indicates that the second depth image is encoded in the bitstream, the method further comprises decoding the second depth image from the bitstream.

8 . A device for reconstructing geometry of a point cloud, comprising:

at least one processor configured to:

decode from a bitstream a first depth image of one or more depth images, the one or more depth images representing different depth values of orthogonally projected points of the point cloud onto a projection plane;

decode, from a SPS message or a PPS message in the bitstream, a depth coding mode associated with a second depth image of the one or more depth images, the depth coding mode indicating whether the second depth image is encoded or not in the bitstream;

obtain a first depth value for at least one first pixel of the first depth image; and

responsive to the depth coding mode, determine a second depth value for at least one second pixel of the second depth image, the at least one second pixel being co-located to the at least one first pixel, the second depth value being determined from the first depth value of the at least one first pixel and a first depth value of at least one neighboring pixel of the at least one first pixel in the first depth image;

wherein the at least one neighboring pixel is obtained responsive to a determination that a spatial distance between the at least one first pixel in the first depth image and the at least one neighboring pixel is below a given threshold.

9 . The device of claim 8 , wherein the second depth value is determined as an average of the first depth value of the at least one neighboring pixel.

10 . The device of claim 8 , wherein the second depth value is determined as a maximum first depth value of the at least one neighboring pixel.

11 . The device of claim 8 , wherein the second depth value is determined as a minimum first depth value of the at least one neighboring pixel.

12 . The device of claim 8 , wherein the at least one processor is further configured to de-project the first depth image and the second depth image.

13 . The device of claim 8 , wherein the depth coding mode is encoded as a metadata associated with a reconstruction of the point cloud whose geometry is represented by the one or more depth images.

14 . The device of claim 8 , wherein the at least one processor is further configured to, if the depth coding mode indicates that the second depth image is encoded in the bitstream, decode the second depth image from the bitstream.

15 . A non-transitory computer-readable medium including instructions for causing one or more processors to perform:

reconstructing geometry of a point cloud including:

decoding from a bitstream a first depth image of one or more depth images, the one or more depth images representing different depth values of orthogonally projected points of the point cloud onto a projection plane;

decoding, from a SPS message or a PPS message in the bitstream, a depth coding mode associated with a second depth image of the one or more depth images, the depth coding mode indicating whether the second depth image is encoded or not in the bitstream;

obtaining a first depth value for at least one first pixel of the first depth image; and

responsive to the depth coding mode, determining a second depth value for at least one second pixel of the second depth image, the at least one second pixel being co-located to the at least one first pixel, the second depth value being determined from the first depth value of the at least one first pixel and a first depth value of at least one neighboring pixel of the at least one first pixel in the first depth image;

wherein the at least one neighboring pixel is obtained responsive to a determination that a spatial distance between the at least one first pixel in the first depth image and the at least one neighboring pixel is below a given threshold.

16 . The non-transitory computer-readable medium of claim 15 , wherein the second depth value is determined as an average of the first depth value of the at least one neighboring pixel.

17 . The non-transitory computer-readable medium of claim 15 , wherein the second depth value is determined as a maximum first depth value of the at least one neighboring pixel.

18 . The non-transitory computer-readable medium of claim 15 , wherein the second depth value is determined as a minimum first depth value of the at least one neighboring pixel.

19 . The non-transitory computer-readable medium of claim 15 , further comprising instructions for causing the one or more processors to de-project the first depth image and the second depth image.

20 . The non-transitory computer-readable medium of claim 15 , wherein the depth coding mode is encoded as a metadata associated with a reconstruction of the point cloud whose geometry is represented by the one or more depth images.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2024
From: GUEDE, CELINE; LLACH, JOAN; CAI, KANGYING
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 067059/0857 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2024
From: LLACH PINSACH, JOAN
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 067060/0483 →
Priority Claims (1)
EP 18305438 · Apr 11, 2018 · regional
Continuity (3)
Continuation 17945672 · Sep 15, 2022
Continuation 17046637 · Apr 1, 2019
Related Publication 20240073453A1 · Feb 29, 2024
References Cited (46)
US 8446958B2 · Kashiwagi et al. · 2013 [cited by applicant]
US 8606028B2 · Noda et al. · 2013 [cited by applicant]
US 9918068B2 · Chang et al. · 2018 [cited by applicant]
US 11477481B2 · Guede · 2022 [cited by examiner]
US 11838547B2 · Guede · 2023 [cited by examiner]
US 20110170602A1 · Lee · 2011 [cited by examiner]
US 20130106849A1 · Ha · 2013 [cited by examiner]
US 20130222534A1 · Rusanovskyy et al. · 2013 [cited by applicant]
US 20140321546A1 · Sakurai et al. · 2014 [cited by applicant]
US 20150062370A1 · Shroff · 2015 [cited by examiner]
US 20150124867A1 · Jaeger et al. · 2015 [cited by applicant]
US 20170251224A1 · Lee · 2017 [cited by examiner]
US 20170347120A1 · Chou et al. · 2017 [cited by applicant]
US 20180332306A1 · Bang · 2018 [cited by examiner]
US 20190087979A1 · Mammou · 2019 [cited by examiner]
US 20200250798A1 · Lasang et al. · 2020 [cited by applicant]
US 20210174559A1 · Nakagami et al. · 2021 [cited by applicant]
CN 102224731A · 2011 [cited by applicant]
CN 103621093A · 2014 [cited by applicant]
CN 103748881A · 2014 [cited by applicant]
CN 104429062A · 2015 [cited by applicant]
CN 106097334A · 2016 [cited by applicant]
CN 106846382A · 2017 [cited by applicant]
CN 107481313A · 2017 [cited by applicant]
EP 1321893A2 · 2003 [cited by applicant]
KR 20200141450A · 2020 [cited by applicant]
RU 2433562C2 · 2011 [cited by applicant]
WO 2013159330A1 · 2013 [cited by applicant]
WO 2014043828A1 · 2014 [cited by applicant]
WO 2019055963A1 · 2019 [cited by applicant]
WO 2019082958A1 · 2019 [cited by applicant]
WO 2019142666A1 · 2019 [cited by applicant]
WO 2019199726A1 · 2019 [cited by applicant]
Sullivan et al., “Report of the 8th meeting of the Joint Video Exploration Team (JVET)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-H1000-v1, Macao, China, Oct.… [cited by applicant]
“English Language Abstract, CN Patent Publication No. 106097334 A”. [cited by applicant]
“English Language Abstract, CN Patent Publication No. 106846382 A”. [cited by applicant]
“English Language Abstract, CN Patent Publication No. 107481313A”. [cited by applicant]
“English Language Translation, Russian Patent No. RU 2433562 C2”. [cited by applicant]
Anonymous, , “Call for Proposals for Point Cloud Compression V2”, ISO/IEC JTC1/SC29/WG11 MPEG2017/N16763, Hobart, Australia, Apr. 2017, 21 pages. [cited by applicant]
De Queiroz, Ricardo L. et al., “Compression of 3D Point Clouds using a Region-Adaptive Hierarchical Transform”, IEEE Transactions on Image Processing; vol. 25, No. 8, Aug. 2016, 10 pages. [cited by applicant]
Guede, et al., “Geometry Image Coding Improvements”, International Organization for Standardization, ISO/IEC JTC 1/SC29/WG11 MPEG/M42111, Coding of Moving Pictures and Audio, Gwangju, Korea, Jan. 2018, 15 pages. [cited by applicant]
ITU-T, , “Reference Software for ITU-T H.265 High Efficiency Video Coding”, Recommendation ITU-T H.265.2, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Oct.… [cited by applicant]
Mammou, Khaled , “PCC Test Model Category 2 V0”, ISO/IEC JTC1/SC29/WG11 N17248, Coding of Moving Picture and Audio, Macau, China, Oct. 2017, 11 pages. [cited by applicant]
Rosewarne, et al., “High Efficiency Video Coding (HEVC) Test Model 16 (HM16) Improved Encoder Description Update 7”, JCTVC-Y1002, Editors, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC … [cited by applicant]
Guede, et al., “PCC CE2.5 Report on optimizations for Depthlmagel geometry information”, SO/IEC JTC1/SC29/WG11 m42626 Apr. 2018, San Diego, US, Apr. 2018, 20 pages. [cited by applicant]
Baroncini, et al., “JVET AHG report: CfP preparation (AHG1)”, JVET-10001 Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 20-26, 2018, 3 pages. [cited by applicant]