IP Library › Granted Patent US 12,230,000
Granted Patent B2
US 12,230,000 · App. 17/046,642 · Granted Feb 18, 2025

Method and apparatus for encoding/decoding a point cloud representing a 3D object

Inventors: Jean-Claude Chevet (Cesson-Sevigne, FR); Yannick Olivier (Cesson-Sevigne, FR); Kangying Cai (Rennes, FR)
Assignee: InterDigital VC Holdings, Inc.
G06T9/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,230,000
App. No.
17/046,642
Granted
Feb 18, 2025
Kind
B2
Abstract

At least one embodiment relates to a method comprising obtaining an occupancy information indicating if blocks of a 2D regular grid defined over a projection plane are associated with depth information of an orthogonal projection of at least one point of a point cloud onto said projection plane; embedding said occupancy information in an image storing said depth information; and encoding said image.

Claims (35)

1. A method comprising:

obtaining an occupancy information indicating whether or not a pixel representative of a projection of a first point of a point cloud onto a projection plane along a projection line is occupied;

storing in an image said occupancy information with a codeword concatenating bits indicating for positions along the projection line between a first depth value of the first point and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

encoding said image.

2. The method of claim 1 , wherein storing said occupancy information comprises shifting the codeword to be stored.

3. The method of claim 1 , further comprising encoding a geometry image comprising the first depth value of the first point.

4. The method of claim 2 , wherein the method further comprises transmitting information to indicate that the codeword has shifted.

5. A device comprising one or more processors configured to:

obtain an occupancy information indicating whether or not a pixel representative of a projection of a first point of a point cloud onto a projection plane along a projection line is occupied;

store in an image said occupancy information with a codeword concatenating bits indicating for positions along the projection line between a first depth value of the first point and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

encode said image.

6. The device of claim 5 , wherein storing said occupancy information with said codeword comprises shifting the codeword to be stored.

7. The device of claim 5 , the one or more processors being further configured to encode a geometry image comprising the first depth value of the first point.

8. The device of claim 6 , wherein the one or more processors are further configured to transmit information to indicate that the codeword has shifted.

9. A method comprising:

decoding an image storing an occupancy information and a codeword concatenating bits indicating for positions along a projection line between a first depth value of a first point of a point cloud projected onto a projection plane along the projection line and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

deriving from the decoded image the occupancy information, said occupancy information indicating whether or not a pixel representative of the projection of the first point onto the projection plane is occupied.

10. The method of claim 9 , wherein the method further comprises receiving an information indicating the codeword has to be shifted, and shifting the decoded codeword according to said received information.

11. The method of claim 9 , further comprising decoding a geometry image comprising the first depth value of the first point.

12. A device comprising one or more processors configured to:

decode an image storing an occupancy information and a codeword concatenating bits indicating for positions along a projection line between a first depth value of a first point of a point cloud projected onto a projection plane along the projection line and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

derive from the decoded image the occupancy information, said occupancy information indicating whether or not a pixel representative of the projection of the first point onto the projection plane is occupied.

13. The device of claim 12 , wherein the one or more processors are further configured to receive an information indicating if the codeword has to be shifted, and to shift the decoded codeword according to said received information.

14. The device of claim 12 , the one or more processors being further configured to decode a geometry image comprising the first depth value of the first point.

15. A non-transitory processor-readable medium including instructions for causing one or more processors to perform:

obtaining an occupancy information indicating whether or not a pixel representative of a projection of a first point of a point cloud onto a projection plane along a projection line is occupied;

storing in an image said occupancy information with a codeword concatenating bits indicating for positions along the projection line between a first depth value of the first point and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

encoding said image.

16. The non-transitory processor-readable medium of claim 15 , wherein the instructions cause the one or more processors to further perform encoding a geometry image comprising the first depth value of the first point.

17. A non-transitory processor-readable medium including instructions for causing one or more processors to perform:

decoding an image storing an occupancy information and a codeword concatenating bits indicating for positions along a projection line between a first depth value of a first point of a point cloud projected onto a projection plane along the projection line and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied; and

deriving from the decoded image the occupancy information, said occupancy information indicating whether or not a pixel representative of the projection of the first point onto the projection plane is occupied.

18. The non-transitory processor-readable medium of claim 17 , wherein the instructions cause the one or more processors to further perform comprising decoding a geometry image comprising the first depth value of the first point.

19. A non-transitory computer-readable medium comprising:

a stored image storing an occupancy information and a codeword concatenating bits indicating for positions along a projection line between a first depth value of a first point of a point cloud projected onto a projection plane along the projection line and a second depth value of a second point of the point cloud projected onto the projection plane along the projection line, whether or not the position is occupied, said occupancy information indicating whether or not a pixel representative of the projection of the first point onto the projection plane is occupied.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2020
From: CHEVET, JEAN-CLAUDE; OLIVIER, YANNICK; CAI, KANGYING
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 054613/0319 →
Priority Claims (2)
EP 18305431 · Apr 11, 2018 · regional
EP 18306132 · Aug 23, 2018 · regional
Continuity (1)
Related Publication 20210183109A1 · Jun 17, 2021
References Cited (61)
US 7003136B1 · Harville · 2006 [cited by applicant]
US 10547867B2 · Ugur · 2020 [cited by applicant]
US 20030214502A1 · Park et al. · 2003 [cited by applicant]
US 20110007072A1 · Khan et al. · 2011 [cited by applicant]
US 20140119456A1 · Bivolarsky · 2014 [cited by applicant]
US 20140132721A1 · Martinez Bauza et al. · 2014 [cited by applicant]
US 20140204088A1 · Kirk et al. · 2014 [cited by applicant]
US 20140285486A1 · Chang et al. · 2014 [cited by applicant]
US 20150381968A1 · Arora et al. · 2015 [cited by applicant]
US 20160021355A1 · Alpaslan et al. · 2016 [cited by applicant]
US 20160086353A1 · Lukac et al. · 2016 [cited by applicant]
US 20160275690A1 · Siddiqui · 2016 [cited by examiner]
US 20160307368A1 · Akeley et al. · 2016 [cited by applicant]
US 20170094262A1 · Peterson et al. · 2017 [cited by applicant]
US 20170214916A1 · Lu et al. · 2017 [cited by applicant]
US 20170214943A1 · Cohen et al. · 2017 [cited by applicant]
US 20170347055A1 · Dore et al. · 2017 [cited by applicant]
US 20170347120A1 · Chou et al. · 2017 [cited by applicant]
US 20180020238A1 · Liu et al. · 2018 [cited by applicant]
US 20190195616A1 · Cao et al. · 2019 [cited by applicant]
US 20190197739A1 · Sinharoy et al. · 2019 [cited by applicant]
US 20210174559A1 · Nakagami et al. · 2021 [cited by applicant]
CN 104854621A · 2015 [cited by applicant]
CN 105556965A · 2016 [cited by applicant]
CN 106662749A · 2017 [cited by applicant]
CN 107025673A · 2017 [cited by applicant]
EP 3151559A1 · 2017 [cited by applicant]
EP 3301926A1 · 2018 [cited by applicant]
EP 3340629A1 · 2018 [cited by applicant]
JP 2014112748 · 2014 [cited by applicant]
JP 2014112748A · 2014 [cited by applicant]
JP 2016511457A · 2016 [cited by applicant]
KR 101284137B1 · 2013 [cited by applicant]
RU 2241933C2 · 2004 [cited by applicant]
RU 2421933C2 · 2011 [cited by applicant]
WO WO2019142666A1 · 2001 [cited by applicant]
WO WO2016003340A1 · 2016 [cited by applicant]
WO WO2018039871A1 · 2018 [cited by applicant]
WO WO2018050529A1 · 2018 [cited by applicant]
WO 2018059946A1 · 2018 [cited by applicant]
WO 2019142163A1 · 2019 [cited by applicant]
Khaleb Mammou (PCC Test Model Category 2 v0, Oct. 2017, International Organisation for Standardisation Organisation Internationale De Norivialisation ISO/IEC JTC1/SC29/WG 11 Coding of Moving Pictures and Audio. (Year: 2… [cited by examiner]
Sinharoy et al., Lossless Coding in TMC2, Jan. 2018, International Organisation for Standardisation Organisation Internationale De Norivialisation ISO/IEC JTC1/SC29/WG 11 Coding of Moving Pictures and Audio (Year: 2018). [cited by examiner]
KhalebMammou,PCCTestModelCategory2v0,Oct. 2017,Internationalorganisationforstandardisation Organisationinternationaledenormalisationiso/IECJTC1/SC29/WG11Codingofmovingpicturesand Audio (Year: 2017). [cited by examiner]
Sinharoyeal.,LosslessCodinginTMC2,Jan. 2018,Internationalorganisationforstandardisation Organisationinternationaledenorivialisationiso/IECJTC1/SC29/WG11Codingofmovingpicturesand Audio(Year:2018) (Year: 2018). [cited by examiner]
Caietal.SignalmultiplepointsalongoneprojectionlineinPCCTMC2losslessmode,Apr. 2018,International Organisationforstandardisationorganisationinternationaledenormalisationiso/IECJTC1/SC29/WG11Codingofmovingpicturesandaudio … [cited by examiner]
Cai et al., “Signal Multiple Points along One Projection Line in PCC TMC2 Lossless Mode”, International Organization for Standardization, ISO/IEC JTC1/SC29/WG11, Coding of Moving Picture and Audio, Document MPEG2018/m42… [cited by applicant]
Anonymous, “Call for Proposals for Point Cloud Compression V2”, International Organization for Standardization, ISO/IEC JTC1/SC29/WG11, Coding of Moving Picture and Audio, Document MPEG2017/N16763, Hobart, Australia, Ap… [cited by applicant]
Mammou, K. (Ed.), “PCC Test Model Category 2 v0”, International Organization for Standardization, ISO/IEC JTC1/ SC29/WG11, Coding of Moving Picture and Audio, Document N17248, Macau, China, Oct. 2017, 11 pages. [cited by applicant]
Hoppe et al., “Surface Reconstruction from Unorganized Points”, SIGGRAPH '92: Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, Jul. 1992, pp. 71-78. [cited by applicant]
Lee et al., “Development of Underwater Terrain's Depth Map Representation Method based on Occupancy Grids with 3D Point Cloud from Polar Sonar Sensor System”, 2016 13th International Conference on Ubiquitous Robots and … [cited by applicant]
Sinharoy et al., “Lossless Coding in TMC2”, International Organization for Standardization, ISO/IEC JTC1/SC29/ WG11, Coding of Moving Picture and Audio, Document MPEG2018/m42170, Gwangju, Korea, Jan. 2018, 10 pages. [cited by applicant]
Plaza-Leiva et al., “Occupancy Grids Generation based on Geometric-Featured Voxel Maps”, 2015 23rd Mediterranean Conference on Control and Automation (MED), Torremolinos, Spain, Jun. 16, 2015, pp. 766-771. [cited by applicant]
Cai et al., “Remove Occupancy Map Coding in PCC TMC2 Lossless Mode”, International Organization for Standardization, ISO/IEC JTC1/SC29/WG11, Coding of Moving Picture and Audio, Document MPEG2018/m42653, San Diego, CA, U… [cited by applicant]
Anonymous, “High Efficiency Video Coding”, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Recommendation ITU-T H.265, Feb. 2018, 692 pages. [cited by applicant]
Levkovish-Maslyuk et al., “Depth Image-Based Representation and Compression for Static and Animated 3-D Objects”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 14, No. 7, Jul. 2004, pp. 1032-1045. [cited by applicant]
Golla et al., “Real-Time Point Cloud Compression”, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, Sep. 28, 2015, 6 pages. [cited by applicant]
De Queiroz et al., “Compression of 3D Point Clouds using a Region-Adaptive Hierarchical Transform”, IEEE Transactions on Image Processing, vol. 25, No. 8, Aug. 2016, pp. 3947-3956. [cited by applicant]
He et al., “Best-Effort Projection Based Attribute Compression for 3D Point Cloud”, 2017 23rd Asia-Pacific Conference on Communications (APCC), Perth, Australia, IEEE, Dec. 11, 2017, 6 pages. [cited by applicant]
ITU-T, “High Efficiency Video Coding”, Recommendation ITU-T H.265 Standard, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Dec. 2016, 664 pages. [cited by applicant]
Cui, et al., “Hybrid Color Attribute Compression for Point Cloud Data”, Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) 2017, Jul. 10-14, 2017, 6 pages. [cited by applicant]
Cited By (1)
US 12,513,330