IP Library Granted Patent US 11,455,748
Granted Patent B2
US 11,455,748 · App. 16/753,782 · Granted Sep 27, 2022

Method and device for up-sampling a point cloud

Inventors: Kangying Cai (Rennes, FR); Celine Guede (Cesson-Sevigne, FR); Joan Llach Pinsach (Cesson-Sevigne, FR); Sebastien Lasserre (Thorigné Fouillard, FR)
Assignee: InterDigital VC Holdings, Inc.
G06T9/00G06T19/20G06T2210/56G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,455,748
App. No.
16/753,782
Granted
Sep 27, 2022
Kind
B2
Abstract

This method for up-sampling a point cloud representing a 3D object, comprises: —detecting ( 2 ) points belonging to at least one under-sampled region of the point cloud on the basis of at least one desirable sampling rate (K); —obtaining ( 12 ), for each detected point, an associated tangent plane; —inserting ( 14 ) in the point cloud at least one neighboring point of each detected point if a distance between the neighboring point and the tangent plane associated with the detected point is less than a first threshold.

Claims (30)

1. A method comprising:

detecting a plurality of points of a point cloud, wherein a detected point has a number of distance-S neighbors being less than a first value and a number of distance-S′ neighbors being greater than a second value, wherein S′ is larger than S;

obtaining, for the plurality of detected points, associated planes; and

inserting in the point cloud at least one neighboring point for each of the plurality of detected points based on a distance between the neighboring point and the plane associated with the detected point.

2. The method of claim 1 , wherein the plurality of points of a point cloud are detected on a basis of at least one sampling rate, and wherein the at least one sampling rate is defined as a minimum number of neighbors of each point of the point cloud in a sphere or a cube whose center is the point and having a given size.

3. The method of claim 1 , wherein it is decided whether the neighboring point is inserted depending on one or more of:

the number of the distance-S neighbors; or

a change of a distance between a further neighborhood defined by the distance S′ and a local neighborhood defined by the distance S of the detected point when the neighboring point is inserted.

4. The method of claim 1 , wherein the plane associated with the detected point is determined using a Principal Component Analysis (PCA) technique.

5. The method of claim 1 , further comprising determining an attribute of each inserted point.

6. The method of claim 5 , wherein the attribute is a color.

7. The method of claim 5 , wherein the attribute is determined by interpolation from nearby points of the point cloud.

8. The method of claim 7 , wherein the interpolation is performed in a R, G, B color space or in a Y, U, V color space.

9. A method for coding a point cloud representing a 3D object, comprising an up-sampling post-processing according to claim 1 .

10. A method for decoding, from a bitstream, a point cloud representing a 3D object, comprising an up-sampling post-processing according to claim 1 .

11. An apparatus comprising a memory and one or more processors configured to:

detect a plurality of points of a point cloud, wherein a detected point has a number of distance-S neighbors being less than a first value and a number of distance-S′ neighbors being greater than a second value, wherein S′ is larger than S;

obtain, for the plurality of detected points, associated planes; and

insert in the point cloud at least one neighboring point for each of the plurality of detected points based on a distance between the neighboring point and the plane associated with the detected point.

12. The apparatus of claim 11 , wherein the plurality of points of a point cloud are detected on a basis of at least one sampling rate, and wherein the at least one sampling rate is defined as a minimum number of neighbors of each point of the point cloud in a sphere or a cube whose center is the point and having a given size.

13. The apparatus of claim 11 , wherein it is decided whether the neighboring point is inserted depending on one or more of:

the number of the distance-S neighbors; or

a change of a distance between a further neighborhood defined by the distance S′ and a local neighborhood defined by the distance S of the detected point when the neighboring point is inserted.

14. The apparatus of claim 11 , wherein the plane associated with the detected point is determined using a Principal Component Analysis (PCA) technique.

15. The apparatus of claim 11 , wherein the one or more processors are further configured to determine an attribute of each inserted point.

16. The apparatus of claim 15 , wherein the attribute is a color.

17. The apparatus of claim 15 , wherein the attribute is determined by interpolation from nearby points of the point cloud.

18. The apparatus of claim 17 , wherein the interpolation is performed in a R, G, B color space or in a Y, U, V color space.

19. An encoder comprising the apparatus of claim 11 .

20. A decoder comprising the apparatus of claim 11 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2020
From: CAI, KANGYING; LLACH, JOAN; GUEDE, CELINE; LASSERRE, SEBASTIEN
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 054562/0730 →
Priority Claims (1)
EP 17306347 · Oct 6, 2017 · regional
Continuity (1)
Related Publication 20200258261A1 · Aug 13, 2020
Cited By (1)
US 12,450,781