IP Library › Granted Patent US 12,367,542
Granted Patent B2
US 12,367,542 · App. 17/884,684 · Granted Jul 22, 2025

Point cloud processing method and electronic device

Inventors: Zhisong Liu (Shenzhen, CN); Zijia Wang (WeiFang, CN); Zhen Jia (Shanghai, CN)
Assignee: Dell Products L.P.
G06T3/40G06T17/00G06T2210/36G06T2210/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,542
App. No.
17/884,684
Granted
Jul 22, 2025
Kind
B2
Abstract

A method in an illustrative embodiment includes: obtaining a first point cloud based on an input point cloud, a point number of the first point cloud being greater than a point number of the input point cloud; obtaining a first group of point clouds based on the first point cloud, the first group of point clouds including a plurality of point clouds; obtaining a second group of point clouds based on the input point cloud and the first group of point clouds, the second group of point clouds including a plurality of point clouds; and obtaining a target point cloud based on the first point cloud and the second group of point clouds, a point number of the target point cloud being greater than the point number of the input point cloud.

Claims (85)

1. A point cloud processing method, comprising:

obtaining a first point cloud based on an input point cloud, a point number of the first point cloud being greater than a point number of the input point cloud;

obtaining a first group of point clouds based on the first point cloud, the first group of point clouds comprising a plurality of point clouds;

obtaining a second group of point clouds based on the input point cloud and the first group of point clouds, the second group of point clouds comprising a plurality of point clouds; and

obtaining a target point cloud based on the first point cloud and the second group of point clouds, a point number of the target point cloud being greater than the point number of the input point cloud;

wherein obtaining the second group of point clouds based on the input point cloud and the first group of point clouds comprises:

obtaining at least one additional group of point clouds based on the input point cloud and the first group of point clouds, the at least one additional group of point clouds comprising a plurality of point clouds; and

obtaining the second group of point clouds based on the at least one additional group of point clouds;

wherein the at least one additional group of point clouds comprises a third group of point clouds, a point number of the second group of point clouds being greater than a point number of the third group of point clouds.

2. The method according to claim 1 , wherein obtaining the first point cloud based on the input point cloud comprises:

generating a feature value of the input point cloud based on coordinates of the input point cloud;

obtaining a feature value of the first point cloud based on the feature value of the input point cloud; and

generating coordinates of the first point cloud based on the feature value of the first point cloud.

3. The method according to claim 2 , wherein obtaining the feature value of the first point cloud based on the feature value of the input point cloud comprises:

upsampling the feature value of the input point cloud to obtain a first feature value;

downsampling the first feature value to obtain a second feature value;

calculating a difference value between the feature value of the input point cloud and the second feature value to obtain a first residual feature value;

upsampling the first residual feature value to obtain a third feature value; and

adding the third feature value and the first feature value to obtain the feature value of the first point cloud.

4. The method according to claim 1 , wherein obtaining the first group of point clouds based on the first point cloud comprises:

downsampling the first point cloud to obtain the first group of point clouds.

5. The method according to claim 1 , wherein obtaining the target point cloud based on the first point cloud and the second group of point clouds comprises:

performing accumulation calculation on coordinates of the first point cloud and coordinates of each of corresponding point clouds in the second group of point clouds to obtain the target point cloud.

6. The method according to claim 1 , wherein obtaining the third group of point clouds based on the input point cloud and the first group of point clouds comprises:

calculating a difference value between coordinates of the input point cloud and coordinates of each of corresponding point clouds in the first group of point clouds respectively to obtain a group of residuals.

7. The method according to claim 1 , wherein obtaining the second group of point clouds based on the third group of point clouds comprises:

generating a feature value of each point cloud in the third group of point clouds based on coordinates of each point cloud in the third group of point clouds;

obtaining a feature value of each point cloud in the second group of point clouds based on the feature value of each point cloud in the third group of point clouds; and

generating coordinates of each point cloud in the second group of point clouds based on the feature value of each point cloud in the second group of point clouds.

8. The method according to claim 7 , wherein obtaining the feature value of each point cloud in the second group of point clouds based on the feature value of each point cloud in the third group of point clouds comprises:

upsampling the feature value of each point cloud in the third group of point clouds to obtain a fourth feature value;

downsampling the fourth feature value to obtain a fifth feature value;

calculating a difference value between the feature value of each point cloud in the third group of point clouds and the fifth feature value to obtain a second residual feature value;

upsampling the second residual feature value to obtain a sixth feature value; and

adding the sixth feature value and the fourth feature value to obtain the feature value of each point cloud in the second group of point clouds.

9. An electronic device for point cloud processing, comprising:

at least one processor; and

memory coupled to the at least one processor and having instructions stored therein, wherein the instructions, when executed by the at least one processor, cause the electronic device to perform actions comprising:

obtaining a first point cloud based on an input point cloud, a point number of the first point cloud being greater than a point number of the input point cloud;

obtaining a first group of point clouds based on the first point cloud, the first group of point clouds comprising a plurality of point clouds;

obtaining a second group of point clouds based on the input point cloud and the first group of point clouds, the second group of point clouds comprising a plurality of point clouds; and

obtaining a target point cloud based on the first point cloud and the second group of point clouds, a point number of the target point cloud being greater than the point number of the input point cloud;

wherein obtaining the second group of point clouds based on the input point cloud and the first group of point clouds comprises:

obtaining at least one additional group of point clouds based on the input point cloud and the first group of point clouds, the at least one additional group of point clouds comprising a plurality of point clouds; and

obtaining the second group of point clouds based on the at least one additional group of point clouds;

wherein the at least one additional group of point clouds comprises a third group of point clouds, a point number of the second group of point clouds being greater than a point number of the third group of point clouds.

10. The electronic device according to claim 9 , wherein obtaining the first point cloud based on the input point cloud comprises:

generating a feature value of the input point cloud based on coordinates of the input point cloud;

obtaining a feature value of the first point cloud based on the feature value of the input point cloud; and

generating coordinates of the first point cloud based on the feature value of the first point cloud.

11. The electronic device according to claim 10 , wherein obtaining the feature value of the first point cloud based on the feature value of the input point cloud comprises:

upsampling the feature value of the input point cloud to obtain a first feature value;

downsampling the first feature value to obtain a second feature value;

calculating a difference value between the feature value of the input point cloud and the second feature value to obtain a first residual feature value;

upsampling the first residual feature value to obtain a third feature value; and

adding the third feature value and the first feature value to obtain the feature value of the first point cloud.

12. The electronic device according to claim 9 , wherein obtaining the first group of point clouds based on the first point cloud comprises:

downsampling the first point cloud to obtain the first group of point clouds.

13. The electronic device according to claim 9 , wherein obtaining the target point cloud based on the first point cloud and the second group of point clouds comprises:

performing accumulation calculation on coordinates of the first point cloud and coordinates of each of corresponding point clouds in the second group of point clouds to obtain the target point cloud.

14. The electronic device according to claim 9 , wherein obtaining the third group of point clouds based on the input point cloud and the first group of point clouds comprises:

calculating a difference value between coordinates of the input point cloud and coordinates of each of corresponding point clouds in the first group of point clouds respectively to obtain a group of residuals.

15. The electronic device according to claim 9 , wherein obtaining the second group of point clouds based on the third group of point clouds comprises:

generating a feature value of each point cloud in the third group of point clouds based on coordinates of each point cloud in the third group of point clouds;

obtaining a feature value of each point cloud in the second group of point clouds based on the feature value of each point cloud in the third group of point clouds; and

generating coordinates of each point cloud in the second group of point clouds based on the feature value of each point cloud in the second group of point clouds.

16. The electronic device according to claim 15 , wherein obtaining the feature value of each point cloud in the second group of point clouds based on the feature value of each point cloud in the third group of point clouds comprises:

upsampling the feature value of each point cloud in the third group of point clouds to obtain a fourth feature value;

downsampling the fourth feature value to obtain a fifth feature value;

calculating a difference value between the feature value of each point cloud in the third group of point clouds and the fifth feature value to obtain a second residual feature value;

upsampling the second residual feature value to obtain a sixth feature value; and

adding the sixth feature value and the fourth feature value to obtain the feature value of each point cloud in the second group of point clouds.

17. A computer program product tangibly stored on a non-transitory computer-readable medium and comprising machine-executable instructions, wherein the machine-executable instructions, when executed by a machine, cause the machine to perform actions comprising:

obtaining a first point cloud based on an input point cloud, a point number of the first point cloud being greater than a point number of the input point cloud;

obtaining a first group of point clouds based on the first point cloud, the first group of point clouds comprising a plurality of point clouds;

obtaining a second group of point clouds based on the input point cloud and the first group of point clouds, the second group of point clouds comprising a plurality of point clouds; and

obtaining a target point cloud based on the first point cloud and the second group of point clouds, a point number of the target point cloud being greater than the point number of the input point cloud;

wherein obtaining the second group of point clouds based on the input point cloud and the first group of point clouds comprises:

obtaining at least one additional group of point clouds based on the input point cloud and the first group of point clouds, the at least one additional group of point clouds comprising a plurality of point clouds; and

obtaining the second group of point clouds based on the at least one additional group of point clouds;

wherein the at least one additional group of point clouds comprises a third group of point clouds, a point number of the second group of point clouds being greater than a point number of the third group of point clouds.

18. The computer program product according to claim 17 , wherein obtaining the first point cloud based on the input point cloud comprises:

generating a feature value of the input point cloud based on coordinates of the input point cloud;

obtaining a feature value of the first point cloud based on the feature value of the input point cloud; and

generating coordinates of the first point cloud based on the feature value of the first point cloud.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2022
From: LIU, ZHISONG; WANG, ZIJIA; JIA, ZHEN
To: DELL PRODUCTS L.P.
Reel/Frame 060766/0826 →
Priority Claims (1)
CN 202210799006.4 · Jul 6, 2022 · national
Continuity (1)
Related Publication 20240013341A1 · Jan 11, 2024
References Cited (138)
US 5724493A · Hosoya · 1998 [cited by examiner]
US 9633483B1 · Xu · 2017 [cited by examiner]
US 11017566B1 · Tourapis · 2021 [cited by examiner]
US 11288826B1 · Lato · 2022 [cited by examiner]
US 11315271B2 · Li · 2022 [cited by examiner]
US 11403817B1 · Eckman · 2022 [cited by examiner]
US 11704769B1 · Weingartner · 2023 [cited by examiner]
US 11748945B1 · Monaghan · 2023 [cited by examiner]
US 11756281B1 · Casey · 2023 [cited by examiner]
US 11763471B1 · Fang · 2023 [cited by examiner]
US 11763485B1 · Chen · 2023 [cited by examiner]
US 11900566B1 · Ferrés · 2024 [cited by examiner]
US 11935209B1 · Barsky · 2024 [cited by examiner]
US 20110273442A1 · Drost · 2011 [cited by examiner]
US 20130071041A1 · Jin · 2013 [cited by examiner]
US 20130155058A1 · Golparvar-Fard · 2013 [cited by examiner]
US 20130155199A1 · Liu · 2013 [cited by examiner]
US 20140023291A1 · Lin · 2014 [cited by examiner]
US 20140098094A1 · Neumann · 2014 [cited by examiner]
US 20140192050A1 · Qiu · 2014 [cited by examiner]
US 20170132763A1 · Salvador Marcos · 2017 [cited by examiner]
US 20170193692A1 · Huang · 2017 [cited by examiner]
US 20170278221A1 · Ji · 2017 [cited by examiner]
US 20180359486A1 · Lai · 2018 [cited by examiner]
US 20190087979A1 · Mammou · 2019 [cited by examiner]
US 20190088004A1 · Lucas · 2019 [cited by examiner]
US 20190156518A1 · Mammou · 2019 [cited by examiner]
US 20190311500A1 · Mammou · 2019 [cited by examiner]
US 20190313110A1 · Mammou · 2019 [cited by examiner]
US 20190318519A1 · Graziosi · 2019 [cited by examiner]
US 20200021847A1 · Kim · 2020 [cited by examiner]
US 20200184604A1 · Vosoughi · 2020 [cited by examiner]
US 20200219285A1 · Faramarzi · 2020 [cited by examiner]
US 20200314435A1 · Tourapis · 2020 [cited by examiner]
US 20200365134A1 · Tu · 2020 [cited by examiner]
US 20210006833A1 · Tourapis · 2021 [cited by examiner]
US 20210019918A1 · Li · 2021 [cited by examiner]
US 20210035352A1 · Harviainen · 2021 [cited by examiner]
US 20210042501A1 · Mao · 2021 [cited by examiner]
US 20210049779A1 · Harviainen · 2021 [cited by examiner]
US 20210049828A1 · Park · 2021 [cited by examiner]
US 20210090301A1 · Mammou · 2021 [cited by examiner]
US 20210133463A1 · Zheng · 2021 [cited by examiner]
US 20210150726A1 · Kao · 2021 [cited by examiner]
US 20210192793A1 · Engelland-Gay · 2021 [cited by examiner]
US 20210211724A1 · Kim · 2021 [cited by examiner]
US 20210241106A1 · Mehr · 2021 [cited by examiner]
US 20210279950A1 · Phalak · 2021 [cited by examiner]
US 20210279951A1 · Yoon · 2021 [cited by examiner]
US 20210323572A1 · He · 2021 [cited by examiner]
US 20210327128A1 · Yu · 2021 [cited by examiner]
US 20210350147A1 · Yuan · 2021 [cited by examiner]
US 20210366082A1 · Xiao · 2021 [cited by examiner]
US 20210370968A1 · Xiao · 2021 [cited by examiner]
US 20210374947A1 · Shin · 2021 [cited by examiner]
US 20220007037A1 · Cai · 2022 [cited by examiner]
US 20220012591A1 · Dalli · 2022 [cited by examiner]
US 20220012945A1 · Akhtar · 2022 [cited by examiner]
US 20220092802A1 · Jang · 2022 [cited by examiner]
US 20220122305A1 · Smith · 2022 [cited by examiner]
US 20220157014A1 · Sevastopolskiy · 2022 [cited by examiner]
US 20220164565A1 · Li · 2022 [cited by examiner]
US 20220189070A1 · Rejeb Sfar · 2022 [cited by examiner]
US 20220198737A1 · Enthed · 2022 [cited by examiner]
US 20220222824A1 · Usumezbas · 2022 [cited by examiner]
US 20220222891A1 · Lu · 2022 [cited by examiner]
US 20220285009A1 · Sha · 2022 [cited by examiner]
US 20220292765A1 · Le · 2022 [cited by examiner]
US 20220300681A1 · Ren · 2022 [cited by examiner]
US 20220327851A1 · Flagg · 2022 [cited by examiner]
US 20220351332A1 · Jia · 2022 [cited by examiner]
US 20220366646A1 · Lopez Gavilan · 2022 [cited by examiner]
US 20220383640A1 · Vora · 2022 [cited by examiner]
US 20220413464A1 · Zeng · 2022 [cited by examiner]
US 20230019851A1 · Yi · 2023 [cited by examiner]
US 20230019972A1 · Wang · 2023 [cited by examiner]
US 20230027234A1 · Wu · 2023 [cited by examiner]
US 20230042968A1 · Ding · 2023 [cited by examiner]
US 20230047211A1 · Abuelwafa · 2023 [cited by examiner]
US 20230071559A1 · Wang · 2023 [cited by examiner]
US 20230076092A1 · Zhao · 2023 [cited by examiner]
US 20230080852A1 · Meardi · 2023 [cited by examiner]
US 20230082899A1 · Corral-Soto · 2023 [cited by examiner]
US 20230103967A1 · Jang · 2023 [cited by examiner]
US 20230114731A1 · Sivakumar · 2023 [cited by examiner]
US 20230121534A1 · Rukhovich · 2023 [cited by examiner]
US 20230136860A1 · Wang · 2023 [cited by examiner]
US 20230141734A1 · Zhou · 2023 [cited by examiner]
US 20230169727A1 · Sminchisescu · 2023 [cited by examiner]
US 20230186476A1 · Ghazvinian Zanjani · 2023 [cited by examiner]
US 20230215088A1 · Wang · 2023 [cited by examiner]
US 20230222618A1 · Yang · 2023 [cited by examiner]
US 20230230326A1 · Hill · 2023 [cited by examiner]
US 20230252662A1 · Nikitidis · 2023 [cited by examiner]
US 20230260247A1 · Liu · 2023 [cited by examiner]
US 20230260255A1 · Tan · 2023 [cited by examiner]
US 20230281877A1 · Corral-Soto · 2023 [cited by examiner]
US 20230298296A1 · Wang · 2023 [cited by examiner]
US 20230306557A1 · Wang · 2023 [cited by examiner]
US 20230368032A1 · Eckart · 2023 [cited by examiner]
US 20230368468A1 · Eckart · 2023 [cited by examiner]
US 20230377160A1 · Jain · 2023 [cited by examiner]
US 20230377204A1 · Guede · 2023 [cited by examiner]
US 20230377208A1 · Akhtar · 2023 [cited by examiner]
US 20240013342A1 · Liu · 2024 [cited by examiner]
US 20240013406A1 · Chen · 2024 [cited by examiner]
US 20240013415A1 · Tam · 2024 [cited by examiner]
US 20240029297A1 · Zhou · 2024 [cited by examiner]
US 20240029358A1 · Sharma · 2024 [cited by examiner]
US 20240037707A1 · Shan · 2024 [cited by examiner]
US 20240046567A1 · Chaudhuri · 2024 [cited by examiner]
US 20240054661A1 · Nekkah · 2024 [cited by examiner]
US 20240064318A1 · Letunovskiy · 2024 [cited by examiner]
US 20240096076A1 · Zhou · 2024 [cited by examiner]
US 20240103607A1 · Swain · 2024 [cited by examiner]
US 20240119563A1 · Liu · 2024 [cited by examiner]
US 20240127530A1 · Liu · 2024 [cited by examiner]
US 20240135489A1 · Liu · 2024 [cited by examiner]
US 20240144595A1 · Ponjou Tasse · 2024 [cited by examiner]
US 20240153107A1 · Li · 2024 [cited by examiner]
US 20240161478A1 · Ma · 2024 [cited by examiner]
US 20240169532A1 · Avni · 2024 [cited by examiner]
US 20240177353A1 · Yuan · 2024 [cited by examiner]
US 20240221353A1 · Li · 2024 [cited by examiner]
US 20240296528A1 · Xiao · 2024 [cited by examiner]
US 20240346707A1 · Akhtar · 2024 [cited by examiner]
US 20240346765A1 · Sokolova · 2024 [cited by examiner]
US 20250069184A1 · Ravi Kumar · 2025 [cited by examiner]
US 20250095354A1 · Ravi Kumar · 2025 [cited by examiner]
US 20250131651A1 · Miraldo · 2025 [cited by examiner]
P. Zhang, X. Wang, L. Ma, S. Wang, S. Kwong and J. Jiang, “Progressive Point Cloud Upsampling via Differentiable Rendering,” in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, No. 12, pp. 4673-4… [cited by examiner]
X. Li, C.-M. Own, K. Wu and Q. Sun, “CM-Net: a point cloud upsampling network based on adversarial neural network,” 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 2021, pp. 1-8, doi: 10… [cited by examiner]
J. Yang, C. Lee, P. Ahn, H. Lee, E. Yi and J. Kim, “PBP-Net: Point Projection and Back-Projection Network for 3D Point Cloud Segmentation,” 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)… [cited by examiner]
Z.-S. Liu et al., “Image Super-Resolution via Attention based Back Projection Networks,” IEEE International Conference on Computer Vision Workshop, arXiv:1910.04476v1, Oct. 10, 2019, 9 pages. [cited by applicant]
Y. Wang et al., “Dynamic Graph CNN for Learning on Point Clouds,” ACM Transaction on Graphics, arXiv:1801.07829v2, Jun. 11, 2019, 13 pages. [cited by applicant]
W. Yifan et al., “Patch-based Progressive 3D Point Set Upsampling,” IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2019, pp. 5958-5967. [cited by applicant]
L. Yu et al., “PU-Net: Point Cloud Upsampling Network,” IEEE Conference on Computer Vision and Pattern Recognition, arXiv:1801.06761v2, Mar. 26, 2018, 15 pages. [cited by applicant]
R. Li et al., “PU-GAN: A Point Cloud Upsampling Adversarial Network,” IEEE International Conference on Computer Vision, Nov. 2019, pp. 7203-7212. [cited by applicant]