IP Library Granted Patent US 12,450,781
Granted Patent B2
US 12,450,781 · App. 18/402,142 · Granted Oct 21, 2025

Processing a point cloud

Inventors: Julien Ricard (Plouër-sur-Rance, FR); Celine Guede (Cesson-Sevigne, FR); Yannick Olivier (Thorigne Fouillard, FR); Joan Llach Pinsach (London, GB); David Gendron (Chevaigne, FR)
Assignee: InterDigital VC Holdings, Inc.
G06T9/00H04N19/184H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,781
App. No.
18/402,142
Granted
Oct 21, 2025
Kind
B2
Abstract

Described are methods and devices for adding at least one 3D sample to a point cloud frame and for assigning a color-coding mode to said at least one 3D sample, said color-coding mode indicating if color information associated with said at least one 3D sample is explicitly encoded in a bitstream or if said color information is implicit.

Claims (26)

1. A method comprising:

reconstructing at least one current 3D sample of a point cloud using at least one geometry image storing depth values of 3D samples of the point cloud;

determining a maximum depth difference between depth values of neighboring 3D samples of the current 3D sample and a depth value of the current 3D sample; and

adding at least one 3D sample to the point cloud at a same 2 D location as a 2 D sample representing a projection of the current 3 D sample of the point cloud onto an image plane, up to the maximum depth difference.

2. The method of claim 1 , wherein the point cloud is obtained by de-projecting at least one geometry image.

3. The method of claim 1 , wherein a projection of the neighboring 3D samples onto the geometry image and a projection of the current 3D sample onto the geometry image belong to a same patch of the geometry image.

4. The method of claim 1 , wherein a depth value of the at least one 3D sample added to the point cloud belongs to a range from the depth value of the current 3D sample of the point cloud and a depth value being equal to a sum of the depth value of the current 3D sample and the maximum depth difference minus 1.

5. The method of claim 1 , wherein when determining the maximum depth difference between depth values of neighboring 3D samples of the current 3D sample and the depth value of the current 3D sample, a difference between the depth value of the current 3D sample of the point cloud and the depth value of a neighboring 3D sample is ignored if the difference does not belong to a first range of values.

6. The method of claim 1 , wherein the maximum depth difference equals to or is higher than a first value and the first value is 1 or 2.

7. The method of claim 1 , comprising obtaining color information associated with at least one added 3D sample by interpolating color information associated with some other 3D samples of the point cloud.

8. The method of claim 1 , comprising assigning a color-coding mode to the at least one added 3D sample according to the maximum depth difference associated with the added 3D sample, the color-coding mode indicating whether color information associated with the at least one added 3D sample is encoded in a bitstream or not; and wherein responsive to a determination that the color coding mode indicates that the color information is not encoded in the bitstream, color information associated with the at least one added 3D sample is derived from color information associated with at least one 3D sample of the point cloud.

9. The method of claim 1 , wherein a number of the at least one 3D sample added to the point cloud at the same 2D location as the 2D sample representing the projection of the current 3D sample equals the maximum depth difference minus 1.

10. The method of claim 1 , wherein responsive to a determination that the maximum depth difference equals 0 or 1, a single 3D sample is added at the same 2D location as the 2D sample representing the projection of the current 3D sample.

11. A device comprising at least one processor configured to:

reconstruct at least one current 3D sample of a point cloud using at least one geometry image storing depth values of 3D samples of the point cloud;

determine a maximum depth difference between depth values of neighboring 3D sample of the current 3D sample and a depth value of the current 3D sample; and

add at least one 3D sample to the point cloud at a same 2D location as a 2D sample representing a projection of the current 3D sample of the point cloud onto an image plane, up to the maximum depth difference.

12. The device of claim 11 , a depth value of the at least one 3D sample added to the point cloud belongs to a range from the depth value of the current 3D sample of the point cloud and a depth value being equal to a sum of the depth value of the current 3D sample and the maximum depth difference minus 1.

13. The device of claim 11 , wherein when determining the maximum depth difference between depth values of neighboring 3D samples of the current 3D sample and the depth value of the current 3D sample, a difference between the depth value of the current 3D sample of the point cloud and the depth value of a neighboring 3D sample is ignored if the difference does not belong to a first range of values.

14. The device of claim 11 , wherein the at least one processor is further configured to assign a color-coding mode to the at least one added 3D sample, the color-coding mode indicating whether color information associated with the at least one added 3D sample is encoded in a bitstream or not; and wherein responsive to a determination that the color coding mode indicates that the color information is not encoded in the bitstream, color information associated with the at least one added 3D sample is derived from color information associated with at least one 3D sample of the point cloud.

15. The device of claim 11 , wherein a projection of the neighboring 3D samples onto the geometry image and a projection of the current 3D sample onto the geometry image belong to a same patch of the geometry image.

16. The device of claim 11 , wherein the maximum depth difference equals to or is higher than a first value and the first value is 1 or 2.

17. The device of claim 11 , wherein the at least one processor is configured to obtain color information associated with at least one added 3D sample by interpolating color information associated with some other 3D samples of the point cloud.

18. The device of claim 11 , wherein the at least one processor is further configured to, responsive to a determination that the maximum depth difference equals 0 or 1, add a single 3D sample at the same 2D location as the 2D sample representing the projection of the current 3D sample.

19. A non-transitory computer-readable medium including instructions for causing one or more processors to perform reconstructing at least one current 3D sample of a point cloud using at least one geometry image storing depth values of 3D samples of the point cloud, determining a maximum depth difference between depth values of neighboring 3D samples of the current 3D sample and a depth value of the current 3D sample, adding at least one 3D sample to the point cloud at a same 2D location as a 2D sample representing a projection of the curent 3D sample of the point cloud onto an image plane, up to the maximum depth difference.

20. The non-transitory computer-readable medium of claim 19 , wherein a depth value of the at least one 3D sample added to the point cloud belongs to a range from the depth value of the current 3D sample of the point cloud and a depth value being equal to a sum of the depth value of the current 3D sample and the maximum depth difference minus 1.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2024
From: RICARD, JULIEN; GUEDE, CELINE; OLIVIER, YANNICK; LLACH PINSACH, JOAN
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 066785/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2024
From: GENDRON, DAVID
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 066789/0652 →
CONFIRMATORY ASSIGNMENT - INCLUDED THE ENTIRETY OF 4 DOCUMENTS Recorded Mar 15, 2024
From: RICARD, JULIEN; GUEDE, CELINE; OLIVIER, YANNICK; LLACH PINSACH, JOAN
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 066800/0218 →
Priority Claims (3)
EP 18305048 · Jan 19, 2018 · regional
EP 18305420 · Apr 10, 2018 · regional
EP 18305928 · Jul 11, 2018 · regional
Continuity (2)
Continuation 16962908
Related Publication 20240169593A1 · May 23, 2024
References Cited (44)
US 6963671B2 · Frisken et al. · 2005 [cited by applicant]
US 9342867B2 · Lee et al. · 2016 [cited by applicant]
US 9594974B2 · Fu et al. · 2017 [cited by applicant]
US 9607388B2 · Lin et al. · 2017 [cited by applicant]
US 9716889B2 · Ikeda · 2017 [cited by applicant]
US 10070115B2 · Graziosi et al. · 2018 [cited by applicant]
US 11455748B2 · Cai et al. · 2022 [cited by applicant]
US 20030138048A1 · Hall et al. · 2003 [cited by applicant]
US 20030198404A1 · Frisken et al. · 2003 [cited by applicant]
US 20050244065A1 · Malvar et al. · 2005 [cited by applicant]
US 20090213240A1 · Sim · 2009 [cited by examiner]
US 20150326864A1 · Lainema · 2015 [cited by applicant]
US 20170214943A1 · Cohen et al. · 2017 [cited by applicant]
US 20170347055A1 · Dore et al. · 2017 [cited by applicant]
US 20170347122A1 · Chou et al. · 2017 [cited by applicant]
US 20180053324A1 · Cohen et al. · 2018 [cited by applicant]
US 20180190016A1 · Yang · 2018 [cited by applicant]
US 20180293744A1 · Yu · 2018 [cited by applicant]
US 20190200046A1 · Lucas et al. · 2019 [cited by applicant]
CN 106471805A · 2017 [cited by applicant]
CN 107004134A · 2017 [cited by applicant]
CN 107230225A · 2017 [cited by applicant]
CN 107590825A · 2018 [cited by applicant]
JP 2004038933A · 2004 [cited by applicant]
JP 2008005531A · 2008 [cited by applicant]
JP 2009301361A · 2009 [cited by applicant]
JP 2017529620A · 2017 [cited by applicant]
WO 2017100487A1 · 2017 [cited by applicant]
WO 2019142163A1 · 2019 [cited by applicant]
“English Language PatDoc Translation, Japanese Publication No. JP2009301361A”. [cited by applicant]
Anonymous, , “Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video”, ISO 13818-2: 1995 (E), Recommendation ITU-T H.262, International Organization for Standardization (ISO) an… [cited by applicant]
He, , “Best-Effort Projection Based Attribute Compression for 3D Point Cloud”, 2017 23rd Asia-Pacific Conference on Communications (APCC), Perth, Australia, Dec. 11, 2017, 6 pages. [cited by applicant]
Hoppe, et al., “Surface Reconstruction from Unorganized Points”, Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, Jul. 1992, pp. 71-78. [cited by applicant]
Huang, et al., “A Generic Scheme for Progressive Point Cloud Coding”, IEEE Transactions on Visualization and Computer Graphics, vol. 14, No. 2, Mar.-Apr. 2008, pp. 1-14. [cited by applicant]
ISO/IEC, , “PCC Test Model Category 2 Vo”, ISO/IEC JTC1/SC29/WG11 N17248, Coding of Moving Picture and Audio, Macau, China, Oct. 2017, 11 pages. [cited by applicant]
ISO/IEC, , “Text of ISO/IEC CD 23090 5: Video-based Point Cloud Compression”. 3DG subgroup, ISO/IEC JTC1/SC29/WG11 N18030, Macau, China, Oct. 2018, 73 pages. [cited by applicant]
ITU-T, , “High Efficiency Video Coding”, Recommendation ITU-T H.265 Standard, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Dec. 2016, 664 pages. [cited by applicant]
ITU-T, , “Reference Software for ITU-T H.265 High Efficiency Video Coding”, Recommendation ITU-T H.265.2, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Oct.… [cited by applicant]
Lasserre, Sebastien et al., “Technicolor Response to the CfP on PCC (Cat 2) based on a hybrid image/geometry scheme”, 120. MPEG Meeting; Oct. 23, 2017-Oct. 27, 2017; Macau; (Motion Picture Expert Group or ISO/IEC JTC1/S… [cited by applicant]
Ricard, J. , “[V-PCC] V-PCC Test Model v4”, Technicolor, ISO/IEC JTC1/SC29/WG11 MPEG2018/m460xx, Macau, CH, Oct. 2018, 3 pages. [cited by applicant]
Song, et al., “Progressive Compression and Transmission of Point Texture Images”, Journal of Visual Communication & Image Representation, vol. 17, No. 5, Nov. 29, 2005, pp. 1090-1107. [cited by applicant]
Song, et al., “Progressive Transmission of Pointtexture 3-d Images”, 2016, pp. 485-488. [cited by applicant]
Xin, et al., “The New Generation of Scalable Video Coding Standard: Background, Features, Techniques and Applications”, Journal of Electronic Measurement and Instrument, vol. 29, No. 10, Oct. 15, 2015, pp. 1415-1423. [cited by applicant]
Guede, et al., “PCC CE2.5 Report on optimizations for DepthImagel geometry information”, Iso/Iec JTC1/SC29/WG11 m42626, San Diego, Apr. 2018, 20 pages. [cited by applicant]