IP Library › Granted Patent US 10,986,364
Granted Patent B2
US 10,986,364 · App. 16/825,051 · Granted Apr 20, 2021

Method and apparatus for interframe point cloud attribute coding

Inventors: Sehoon Yea (Palo Alto, CA); Arash Vosoughi (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/521H04N19/132H04N19/172H04N19/186H04N19/547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,986,364
App. No.
16/825,051
Granted
Apr 20, 2021
Kind
B2
Abstract

A method of interframe point cloud attribute coding is performed by at least one processor and includes obtaining, as a motion estimation unreliability measure of motion estimation of a target frame, a value inversely proportional to a ratio of a number of first point cloud samples of the target frame respectively with second point cloud samples of an interframe reference frame, to a number of point cloud samples in the target frame. The method further includes identifying whether the obtained motion estimation unreliability measure is greater than a predetermined threshold, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skipping motion compensation of the target frame, and based on the obtained motion estimation unreliability measure being identified to be less than or equal to the predetermined threshold, performing the motion compensation of the target frame.

Claims (37)

1. A method of interframe point cloud attribute coding, the method being performed by at least one processor, and the method comprising:

obtaining, as a motion estimation unreliability measure of motion estimation of a target frame, a value inversely proportional to a ratio of a number of first point cloud samples of the target frame respectively with second point cloud samples of an interframe reference frame, to a number of point cloud samples in the target frame;

identifying whether the obtained motion estimation unreliability measure is greater than a predetermined threshold;

based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skipping motion compensation of the target frame; and

based on the obtained motion estimation unreliability measure being identified to be less than or equal to the predetermined threshold, performing the motion compensation of the target frame.

2. The method of claim 1 , wherein a lesser value of the motion estimation unreliability measure indicates a greater uncertainty of the motion estimation, and

a greater value of the motion estimation unreliability measure indicates a lesser uncertainty of the motion estimation.

3. The method of claim 1 , further comprising obtaining the second point cloud samples, using a nearest-neighbor search algorithm.

4. The method of claim 1 , further comprising, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skipping prediction of an attribute of a point included in one among the point cloud samples in the target frame.

5. The method of claim 1 , further comprising performing prediction of an attribute of a point included in one among the point cloud samples in the target frame of which the motion compensation is performed.

6. The method of claim 5 , wherein the attribute comprises either one or both of a color value and a reflectance value of the point.

7. The method of claim 5 , wherein the performing the prediction comprises applying a predicting transform or a lifting transform to the attribute.

8. An apparatus for interframe point cloud attribute coding, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

obtaining code configured to cause the at least one processor to obtain, as a motion estimation unreliability measure of motion estimation of a target frame, a value inversely proportional to a ratio of a number of first point cloud samples of the target frame respectively with second point cloud samples of an interframe reference frame, to a number of point cloud samples in the target frame;

identifying code configured to cause the at least one processor to identify whether the obtained motion estimation unreliability measure is greater than a predetermined threshold;

skipping code configured to cause the at least one processor to, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skip motion compensation of the target frame; and

performing code configured to cause the at least one processor to, based on the obtained motion estimation unreliability measure being identified to be less than or equal to the predetermined threshold, perform the motion compensation of the target frame.

9. The apparatus of claim 8 , wherein a lesser value of the motion estimation unreliability measure indicates a greater uncertainty of the motion estimation, and

a greater value of the motion estimation unreliability measure indicates a lesser uncertainty of the motion estimation.

10. The apparatus of claim 8 , wherein the obtaining code is further configured to cause the at least one processor to obtain the second point cloud samples, using a nearest-neighbor search algorithm.

11. The apparatus of claim 8 , wherein the skipping code is further configured to cause the at least one processor to, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skip prediction of an attribute of a point included in one among the point cloud samples in the target frame.

12. The apparatus of claim 8 , wherein the performing code is further configured to cause the at least one processor to perform prediction of an attribute of a point included in one among the point cloud samples in the target frame of which the motion compensation is performed.

13. The apparatus of claim 12 , wherein the attribute comprises either one or both of a color value and a reflectance value of the point.

14. The apparatus of claim 12 , wherein the performing code is further configured to cause the at least one processor to apply a predicting transform or a lifting transform to the attribute.

15. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

obtain, as a motion estimation unreliability measure of motion estimation of a target frame, a value inversely proportional to a ratio of a number of first point cloud samples of the target frame respectively with second point cloud samples of an interframe reference frame, to a number of point cloud samples in the target frame;

identify whether the obtained motion estimation unreliability measure is greater than a predetermined threshold;

based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skip motion compensation of the target frame; and

based on the obtained motion estimation unreliability measure being identified to be less than or equal to the predetermined threshold, perform the motion compensation of the target frame.

16. The non-transitory computer-readable storage medium of claim 15 , wherein a lesser value of the motion estimation unreliability measure indicates a greater uncertainty of the motion estimation, and

a greater value of the motion estimation unreliability measure indicates a lesser uncertainty of the motion estimation.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to obtain the second point cloud samples, using a nearest-neighbor search algorithm.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skip prediction of an attribute of a point included in one among the point cloud samples in the target frame.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to perform prediction of an attribute of a point included in one among the point cloud samples in the target frame of which the motion compensation is performed.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the attribute comprises either one or both of a color value and a reflectance value of the point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2020
From: YEA, SEHOON; VOSOUGHI, ARASH; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 052176/0805 →
Continuity (2)
Provisional Application 62822765 · Mar 22, 2019
Related Publication 20200304829A1 · Sep 24, 2020