IP Library › Granted Patent US 12,222,422
Granted Patent B2
US 12,222,422 · App. 17/997,997 · Granted Feb 11, 2025

Post-processing of mapping data for improved accuracy and noise-reduction

Inventors: Zhenyu Yang (Palo Alto, CA); Zhenghe Shangguan (Palo Alto, CA); Arjun Sukumar Menon (San Jose, CA); Weifeng Liu (Fremont, CA)
Assignee: DJI RESEARCH LLC
G01S17/89G01S7/4808G01S17/42G01S17/86G01S17/88G06T7/337G06T11/001G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,222,422
App. No.
17/997,997
Granted
Feb 11, 2025
Kind
B2
Abstract

Techniques are disclosed for post-processing mapping data in a movable object environment. A method for post-processing mapping data can include obtaining a plurality of scans, each scan comprising georeferenced mapping data and corresponding payload pose data obtained from a payload supported by an unmanned aerial vehicle (UAV), generating a plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data, generating a pose graph based on identifying a plurality of correspondence points among the plurality of local maps, and optimizing the pose graph by minimizing an error distance between each pair of correspondence points to obtain optimized transforms for two scans among the plurality of the scans.

Claims (53)

1. A method, comprising:

obtaining a plurality of scans, each scan comprising georeferenced mapping data and corresponding payload pose data obtained from a payload supported by a movable object;

generating a plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data;

generating a pose graph from the plurality of local maps, including identifying a plurality of pairs of correspondence points each including two correspondence points from two of the plurality of local maps, respectively, and representing a same point in space; and

optimizing the pose graph by minimizing a distance between the two correspondence points in each of the plurality of pairs of correspondence points to obtain optimized transforms each for two of the plurality of the scans.

2. The method of claim 1 , wherein the plurality of scans includes a plurality of overlapping scans of a target region or a target object.

3. The method of claim 2 , wherein generating the plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data, further comprises:

identifying at least one pair of overlapping scans from the plurality of scans based on point cloud data associated with the at least one pair of overlapping scans; and

combining the at least one pair of overlapping scans into a local map.

4. The method of claim 3 , wherein identifying the at least one pair of overlapping scans from the plurality of scans based on the point cloud data associated with the at least one pair of overlapping scans, further comprises:

determining the at least one pair of overlapping scans are overlapping using iterative closest point (ICP) matching.

5. The method of claim 1 , wherein identifying the plurality of pairs of correspondence points, further comprises:

determining the plurality of pairs of correspondence points using iterative closest point (ICP) matching.

6. The method of claim 5 , wherein determining the plurality of pairs of correspondence points using iterative closest point (ICP) matching, further comprises:

performing ICP matching directly on the georeferenced mapping data.

7. The method of claim 1 , wherein optimizing the pose graph by minimizing the distance between the two correspondence points in each of the plurality of pairs of correspondence points to obtain the optimized transforms, further comprises:

determining one or more cost functions, each cost function corresponding to a pair of correspondence points from the plurality of correspondence points; and

globally solving the one or more cost functions to obtain the optimized transforms.

8. The method of claim 1 , further comprising:

generating optimized point cloud data using the optimized transforms and the plurality of scans.

9. The method of claim 8 , further comprising:

obtaining color data from an RGB camera; and

overlaying the color data on the optimized point cloud data.

10. The method of claim 1 , wherein the payload includes a LiDAR sensor and an inertial measurement unit.

11. A system, comprising:

a movable object;

a payload coupled to the movable object;

a computing device including at least one processor and a memory, the memory including instructions which, when executed by the at least one processor, cause the computing device to:

obtain a plurality of scans from the payload, each scan comprising georeferenced mapping data and corresponding payload pose data obtained from the payload;

generate a plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data;

generate a pose graph from the plurality of local maps, including identifying a plurality of pairs of correspondence points each including two correspondence points from two of the plurality of local maps, respectively, and representing a same point in space; and

optimize the pose graph by minimizing a distance between the two correspondence points in each of the plurality of pairs of correspondence points to obtain optimized transforms each for two of the plurality of the scans.

12. The system of claim 11 , wherein the plurality of scans includes a plurality of overlapping scans of a target region or a target object.

13. The system of claim 12 , wherein to generate the plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data, the instructions, when executed, further cause the computing device to:

identify at least one pair of overlapping scans from the plurality of scans based on point cloud data associated with the at least one pair of overlapping scans; and

combine the at least one pair of overlapping scans into a local map.

14. The system of claim 13 , wherein to identify the at least one pair of overlapping scans from the plurality of scans based on the point cloud data associated with the at least one pair of overlapping scans, the instructions, when executed, further cause the computing device to:

determine the at least one pair of overlapping scans are overlapping using iterative closest point (ICP) matching.

15. The system of claim 13 , wherein to optimize the pose graph by minimizing the distance between the two correspondence points in each of the plurality of pairs of correspondence points to obtain the optimized transforms, the instructions, when executed, further cause the computing device to:

determine a plurality of one or more cost functions, each cost function corresponding to a pair of correspondence points from the plurality of correspondence points; and

globally solve the plurality of one or more cost functions to obtain the optimized transforms.

16. The system of claim 13 , wherein the instructions, when executed, further cause the computing device to:

generate optimized point cloud data using the optimized transforms and the plurality of scans.

17. The system of claim 11 , wherein to identify the plurality of pairs of correspondence points, the instructions, when executed, further cause the computing device to:

determine the plurality of pairs of correspondence points using iterative closest point (ICP) matching.

18. The system of claim 17 , wherein to determine the plurality of pairs of correspondence points using iterative closest point (ICP) matching, the instructions, when executed, further cause the computing device to:

perform ICP matching directly on the georeferenced mapping data.

19. A non-transitory computer readable storage medium including instructions stored thereon which, when executed by a processor, cause the processor to:

obtain a plurality of scans, each scan comprising georeferenced mapping data and corresponding payload pose data obtained from a payload supported by a movable object;

generate a plurality of local maps based on matching portions of the plurality of scans using the georeferenced mapping data;

generate a pose graph from the plurality of local maps, including identifying a plurality of pairs of correspondence points each including two correspondence points from two of the plurality of local maps, respectively, and representing a same point in space; and

optimize the pose graph by minimizing a distance between the two correspondence points in each of the plurality of pairs of correspondence points to obtain optimized transforms each for two of the plurality of the scans.

20. The non-transitory computer readable storage medium of claim 19 , wherein the plurality of scans includes a plurality of overlapping scans of a target region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2025
From: DJI RESEARCH LLC
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 072085/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2022
From: YANG, ZHENYU; SHANGGUAN, ZHENGHE; MENON, ARJUN SUKUMAR; LIU, WEIFENG
To: DJI RESEARCH LLC
Reel/Frame 061676/0883 →
Continuity (2)
Provisional Application 63044965 · Jun 26, 2020
Related Publication 20230177707A1 · Jun 8, 2023
References Cited (3)
US 20190301873A1 · Prasser et al. · 2019 [cited by applicant]
US 20190346271A1 · Zhang et al. · 2019 [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2021/038461, dated Sep. 24, 2021, 9 pages. [cited by applicant]