IP Library Granted Patent US 12,489,920
Granted Patent B2
US 12,489,920 · App. 18/039,633 · Granted Dec 2, 2025

Method and apparatus for predictively coding and decoding depth information of point cloud

Inventors: Wei Zhang (Shenzhen, CN); Fuzheng Yang (Shenzhen, CN); Ke Zhang (Shenzhen, CN); Jiarun Song (Shenzhen, CN)
Assignee: HONOR DEVICE CO., LTD.
H04N19/597H04N19/105
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,489,920
App. No.
18/039,633
Granted
Dec 2, 2025
Kind
B2
Abstract

A method for coding includes: obtaining original point cloud data; creating an adaptive prediction list of the depth information of the point cloud; and predictively coding the depth information of the point cloud based on the adaptive prediction list, to obtain codestream information. According to the present invention, an adaptively updated prediction list of the depth information is created, and an optimal prediction mode is selected from the list to predict the depth information of the point cloud.

Claims (104)

1 . A method for predictively coding depth information of a point cloud, wherein the method comprises:

obtaining original point cloud data;

creating an adaptive prediction list of the depth information of the point cloud, wherein creating the adaptive prediction list of the depth information of the point cloud comprises:

creating a plurality of candidate lists of depth information of a point to be currently coded; and

selecting a value from the plurality of candidate lists of depth information to fill a prediction list, to obtain the adaptive prediction list; and

predictively coding the depth information of the point cloud based on the adaptive prediction list, to obtain codestream information;

wherein creating the plurality of candidate lists of the depth information of the point to be currently coded comprises:

creating the plurality of candidate lists among a first candidate list, a second candidate list, a third candidate list, or a fourth candidate list, wherein:

depth information values of coded points collected by a laser that is a same as a laser for collecting a depth information value of the point to be currently coded are stored in the first candidate list;

depth information values of coded points collected by a laser that is different from the laser for collecting the depth information value of the point to be currently coded are stored in the second candidate list;

depth information values of historically coded points are stored in the third candidate list; and

priori depth information values are stored in the fourth candidate list.

2 . The method for predictively coding depth information of a point cloud according to claim 1 , wherein creating the first candidate list comprises:

initializing a size of the first candidate list; and

inserting a depth information value of a currently coded point into an end of the first candidate list when the first candidate list is not currently filled; and updating the first candidate list based on a first-in-first-out principle when the first candidate list is currently filled.

3 . The method for predictively coding depth information of a point cloud according to claim 1 , wherein creating the second candidate list comprises:

initializing a size of the second candidate list; and

inserting a depth information of a coded point within a scope right above the point to be currently coded currently into the second candidate list when the second candidate list is not currently filled, and a point collected by previous q lasers of a current laser has been coded.

4 . The method for predictively coding depth information of a point cloud according to claim 1 , wherein creating the third candidate list comprises:

initializing a size of the third candidate list; and

inserting a depth information value of a currently coded point into an end of the third candidate list when the third candidate list is not currently filled; and selectively removing a value in the third candidate list based on a preset threshold, and inserting the depth information value of the currently coded point into the end of the list, when the third candidate list is currently filled.

5 . The method for predictively coding depth information of a point cloud according to claim 1 , wherein selecting the value from the plurality of candidate lists of depth information to fill the prediction list, to obtain the adaptive prediction list comprises:

initializing a size of the prediction list;

selecting a value of a quantity from the plurality of candidate lists in an order, and filling the value of the quantity into the prediction list; and

adjusting an order of values in the prediction list, to obtain the adaptive prediction list.

6 . The method for predictively coding depth information of a point cloud according to claim 5 , wherein the selecting the value of the quantity from the plurality of candidate lists in the order, and filling the value of the quantity into the prediction list comprises:

inserting a depth information value in the first candidate list into the prediction list, and selectively inserting another depth information value in the first candidate list into the prediction list based on a first threshold;

selectively inserting a depth information value in the second candidate list into the prediction list based on a second threshold when it is determined that the prediction list is not filled currently;

selectively inserting a depth information value in the third candidate list into the prediction list based on a third threshold when it is determined that the prediction list is not filled currently; and

successively inserting a value in the fourth candidate list into a remaining position of the prediction list when it is determined that the prediction list is not filled currently.

7 . An apparatus for predictively coding depth information of a point cloud, wherein the apparatus comprises:

at least one processor, configured to:

obtain original point cloud data;

create an adaptive prediction list of the depth information of the point cloud, wherein creating the adaptive prediction list of the depth information of the point cloud comprises:

creating a plurality of candidate lists of depth information of a point to be currently coded; and

selecting a value from the plurality of candidate lists of depth information to fill a prediction list, to obtain the adaptive prediction list; and

predictively code the depth information of the point cloud based on the adaptive prediction list, to obtain codestream information;

wherein creating the plurality of candidate lists of the depth information of the point to be currently coded comprises:

creating the plurality of candidate lists among a first candidate list, a second candidate list, a third candidate list, or a fourth candidate list, wherein:

depth information values of coded points collected by a laser that is a same as a laser for collecting a depth information value of the point to be currently coded are stored in the first candidate list;

depth information values of coded points collected by a laser that is different from the laser for collecting the depth information value of the point to be currently coded are stored in the second candidate list;

depth information values of historically coded points are stored in the third candidate list; and

priori depth information values are stored in the fourth candidate list.

8 . The apparatus according to claim 7 , wherein creating the first candidate list comprises:

initializing a size of the first candidate list; and

inserting a depth information value of a currently coded point into an end of the first candidate list when the first candidate list is not currently filled; and updating the first candidate list based on a first-in-first-out principle when the first candidate list is currently filled.

9 . The apparatus according to claim 7 , wherein creating the second candidate list comprises:

initializing a size of the second candidate list; and

inserting a depth information of a coded point within a scope right above the point to be currently coded into the second candidate list when the second candidate list is not currently filled, and a point collected by previous q lasers of a current laser has been coded.

10 . The apparatus according to claim 7 , wherein creating the third candidate list comprises:

initializing a size of the third candidate list; and

inserting a depth information value of a currently coded point into an end of the third candidate list when the third candidate list is not currently filled; and selectively removing a value in the third candidate list based on a preset threshold, and inserting the depth information value of the currently coded point into the end of the list, when the third candidate list is currently filled.

11 . The apparatus according to claim 7 , wherein selecting the value from the plurality of candidate lists of depth information to fill the prediction list, to obtain the adaptive prediction list comprises:

initializing a size of the prediction list;

selecting a value of a quantity from the plurality of candidate lists in an order, and filling the value of the quantity into the prediction list; and

adjusting an order of values in the prediction list, to obtain the adaptive prediction list.

12 . The apparatus according to claim 11 , wherein selecting the value of the quantity from the plurality of candidate lists in the order, and filling the value of the quantity into the prediction list comprises:

inserting a depth information value in the first candidate list into the prediction list, and selectively inserting another depth information value in the first candidate list into the prediction list based on a first threshold;

selectively inserting a depth information value in the second candidate list into the prediction list based on a second threshold when it is determined that the prediction list is not filled currently;

selectively inserting a depth information value in the third candidate list into the prediction list based on a third threshold when it is determined that the prediction list is not filled currently; and

successively inserting a value in the fourth candidate list into a remaining position of the prediction list when it is determined that the prediction list is not filled currently.

13 . A method for predictively decoding depth information of a point cloud, wherein the method comprises:

obtaining codestream information and performing decoding;

creating an adaptive prediction list of the depth information of the point cloud; and

recreating the depth information of the point cloud based on the adaptive prediction list and a prediction mode and predicted residual obtained through decoding, to obtain recreated depth information of the point cloud;

wherein creating the adaptive prediction list of the depth information of the point cloud comprises:

creating a plurality of candidate lists of depth information of a point to be currently coded; and

selecting a value from a candidate list of the plurality of candidate lists to fill a prediction list, to obtain the adaptive prediction list;

wherein creating the plurality of candidate lists of the depth information of the point to be currently coded comprises: creating the plurality of candidate lists among a first candidate list, a second candidate list, a third candidate list, or a fourth candidate list, wherein:

depth information values of coded points collected by a laser that is a same as a laser for collecting a depth information value of the point to be currently coded are stored in the first candidate list:

depth information values of coded points collected by a laser different from the laser for collecting the depth information value of the point to be currently coded currently are stored in the second candidate list:

depth information values of historically coded points are stored in the third candidate list; and

priori depth information values are stored in the fourth candidate list.

14 . The method according to claim 13 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the first candidate list by:

initializing a size of the first candidate list; and

inserting a depth information value of a currently coded point into an end of the first candidate list when the first candidate list is not currently filled; and updating the first candidate list based on a first-in-first-out principle when the first candidate list is currently filled.

15 . The method according to claim 13 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the second candidate list by:

initializing a size of the second candidate list; and

inserting a depth information of a coded point within a scope right above the point to be currently coded into the second candidate list when the second candidate list is not currently filled, and a point collected by previous q lasers of a current laser has been coded.

16 . The method according to claim 13 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the third candidate list by:

initializing a size of the third candidate list; and

inserting a depth information value of a currently coded point into an end of the third candidate list when the third candidate list is not currently filled; and selectively removing a value in the third candidate list based on a preset threshold, and inserting the depth information value of the currently coded point into the end of the list, when the third candidate list is currently filled.

17 . An apparatus for predictively decoding depth information of a point cloud, wherein the apparatus comprises:

at least one processor, configured to:

obtain codestream information and perform decoding;

create an adaptive prediction list of the depth information of the point cloud; and

recreate the depth information of the point cloud based on the adaptive prediction list and a prediction mode and predicted residual obtained through decoding, to obtain recreated depth information of the point cloud;

wherein creating the adaptive prediction list of the depth information of the point cloud comprises:

creating a plurality of candidate lists of the depth information of a point to be currently coded; and

selecting a value from a candidate list of the plurality of candidate lists to fill a prediction list, to obtain the adaptive prediction list; and

wherein creating the plurality of candidate lists of the depth information of the point to be currently coded comprises creating a plurality of candidate lists among a first candidate list, a second candidate list, a third candidate list, or a fourth candidate list, wherein:

depth information values of coded points collected by a laser that is a same as a laser for collecting a depth information value of the point to be currently coded are stored in the first candidate list:

depth information values of coded points collected by a laser different from the laser for collecting the depth information value of the point to be currently coded are stored in the second candidate list:

depth information values of historically coded points are stored in the third candidate list; and

priori depth information values are stored in the fourth candidate list.

18 . The apparatus according to claim 17 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the first candidate list by:

initializing a size of the first candidate list; and

inserting a depth information value of a currently coded point into an end of the first candidate list when the first candidate list is not currently filled; and updating the first candidate list based on a first-in-first-out principle when the first candidate list is currently filled.

19 . The apparatus according to claim 17 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the second candidate list by:

initializing a size of the second candidate list; and

inserting a depth information of a coded point within a scope right above the point to be currently coded into the second candidate list when the second candidate list is not currently filled, and a point collected by previous q lasers of a current laser has been coded.

20 . The apparatus according to claim 17 , wherein creating at least one of the first candidate list, the second candidate list, the third candidate list, or the fourth candidate list comprises creating the third candidate list by:

initializing a size of the third candidate list; and

inserting a depth information value of a currently coded point into an end of the third candidate list when the third candidate list is not currently filled; and selectively removing a value in the third candidate list based on a preset threshold, and inserting the depth information value of the currently coded point into the end of the list, when the third candidate list is currently filled.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2023
From: ZHANG, WEI; YANG, FUZHENG; ZHANG, KE; SONG, JIARUN
To: HONOR DEVICE CO., LTD.
Reel/Frame 065737/0535 →
Priority Claims (1)
CN 202110580227.8 · May 26, 2021 · national
Continuity (1)
Related Publication 20240007669A1 · Jan 4, 2024
References Cited (27)
US 11010931B2 · Yea et al. · 2021 [cited by applicant]
US 11625809B2 · Ricard et al. · 2023 [cited by applicant]
US 20160366442A1 · Liu · 2016 [cited by examiner]
US 20180053324A1 · Cohen et al. · 2018 [cited by applicant]
US 20200296401A1 · Lee et al. · 2020 [cited by applicant]
US 20200302632A1 · Oh et al. · 2020 [cited by applicant]
US 20200381022A1 · Ilola et al. · 2020 [cited by applicant]
US 20210375004A1 · Sugio et al. · 2021 [cited by applicant]
US 20220108484A1 · Ray et al. · 2022 [cited by applicant]
US 20220215596A1 · Van der Auwera · 2022 [cited by examiner]
US 20220398784A1 · Taquet et al. · 2022 [cited by applicant]
CN 109657559A · 2019 [cited by applicant]
CN 110996098A · 2020 [cited by applicant]
CN 112218079A · 2021 [cited by applicant]
CN 112565734A · 2021 [cited by applicant]
CN 112673398A · 2021 [cited by applicant]
TW 202037169A · 2020 [cited by applicant]
WO 2020014011A1 · 2020 [cited by applicant]
WO 2020175708A1 · 2020 [cited by applicant]
WO 2020190097A1 · 2020 [cited by applicant]
WO 2020246689A1 · 2020 [cited by applicant]
WO 2021084292A1 · 2021 [cited by applicant]
Jae-Kyun Ahn et al., “Large-Scale 3D Point Cloud Compression Using Adaptive Radial Distance Prediction in Hybrid Coordinate Domains”, Selected Topics in Signal Processing, IEEE Journal of. 9. pp. 422-434, Nov. 13, 2014. [cited by applicant]
Simone Milani et al.,“A Transform Coding Strategy for Dynamic Point Clouds,” in IEEE Transactions on Image Processing, vol. 29, pp. 8213-8225, Dec. 21, 2020. [cited by applicant]
Jonathan Taquet(Xiaomi) et al: “[G-PCC][New]EE13.51 related—Improved List of Predictors”, 134. MPEG Meeting; Apr. 26-Apr. 30, 20210 ; Online; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m5674421 Apr. 20… [cited by applicant]
Jonathan Taquet(Xiaomi) et al: “[G-PCC][New]EE13.51 related—Improved List of Predictors”, 134. MPEG Meeting; Apr. 26-Apr. 30, 2021 ; Online; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WVG11), No. m5674421 Apr. 20… [cited by applicant]
S. Schwarz et al., “Emerging MPEG Standards for Point Cloud Compression,” in IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 9, No. 1, pp. 133-148, Mar. 2019. [cited by applicant]