IP Library › Granted Patent US 12,019,458
Granted Patent B2
US 12,019,458 · App. 17/449,174 · Granted Jun 25, 2024

Systems and methods for coordinating device actions

Inventors: You Zhou (Shenzhen, CN); Xuyang Feng (Shenzhen, CN); Cong Zhao (Shenzhen, CN); Jiaqi Yan (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
G05D1/104B64C39/024G05D1/0094B64U2101/30B64U2201/102
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,019,458
App. No.
17/449,174
Granted
Jun 25, 2024
Kind
B2
Abstract

Systems, methods, and computer-readable storage devices for obstacle detection may include an exemplary method of obstacle detection by a computing device. The method includes receiving a first dataset indicating a first surrounding with a first perspective; receiving a second dataset indicating a second surrounding with a second perspective; and generating a composite dataset from the first and second datasets. The method additionally includes identifying an obstacle using the composite dataset.

Claims (45)

1. An obstacle avoidance method for a first movable object, the method comprising:

receiving a first dataset indicating a first surrounding with a first perspective, the first dataset including a first image taken by the first movable object;

receiving, by the first movable object, a second dataset indicating a second surrounding with a second perspective from an external source of the first movable object:

generating a composite dataset from the first and the second datasets;

extracting parameters describing a structure from the composite dataset, the parameters including at least one of a distance of the structure from the first movable object, a location and a size of the structure, and motion of the structure;

determining that the first movable object has potential collision with the structure n a moving path of the first movable object based on the extracted parameters;

identifying the structure as an obstacle; and

causing the first movable object to avoid the obstacle by altering the moving path of the first movable object.

2. The method of claim 1 , wherein the second dataset includes a second image taken by a second movable object.

3. The method of claim 2 , further comprising: altering a moving path of the second movable object based on an altered moving path of the first movable object.

4. The method of claim 1 , wherein the composite dataset contains three-dimensional information indicating at least one of a size or a location of at least one object.

5. The method of claim 1 , wherein generating the composite dataset from the first dataset and the second dataset includes:

generating the composite dataset by combining the first dataset and the second dataset using a structure from motion (SfM) algorithm.

6. The method of claim 1 , wherein determining that the first movable object has potential collision with the structure in the moving path of the first movable object based on the extracted parameters comprises:

determining that the structure and the moving path of the first movable object intersects with each other.

7. The method of claim 1 , wherein at least a part of the second surrounding with the second perspective is not detectable by the first movable object.

8. A non-transitory computer-readable medium storing instructions that, when executed, cause a computing device to perform an obstacle avoidance method for a movable object, the method comprising:

receiving a first dataset indicating a first surrounding with a first perspective;

receiving a second dataset indicating a second surrounding with a second perspective;

generating a composite dataset from the first dataset and the second dataset;

extracting parameters describing a structure from the composite dataset, the parameters including at least one of a distance of the structure from the movable object, a location and a size of the structure, and motion of the structure;

determining that the movable object has potential collision with the structure in a moving path of the movable object based on the extracted parameters;

identifying the structure as an obstacle; and

causing the movable object to avoid the obstacle by altering the moving path of the movable object.

9. The non-transitory computer-readable medium of claim 8 , wherein the first dataset includes a first image taken by a first movable object and the second dataset includes a second image taken by a second movable object.

10. The non-transitory computer-readable medium of claim 9 , wherein the method further comprises: altering a moving path of the second movable object based on an altered moving path of the first movable object.

11. The non-transitory computer-readable medium of claim 8 , wherein the composite dataset contains three-dimensional information indicating at least one of a size or a location of at least one object.

12. The non-transitory computer-readable medium of claim 8 , wherein the computing device is coupled to the movable object.

13. The non-transitory computer-readable medium of claim 8 , wherein at least a part of the second surrounding with the second perspective is not detectable by the first movable object.

14. A system of obstacle avoidance for a movable object by a computing device comprising:

one or more processors, and

configured to:

receive a first dataset indicating a first surrounding with a first perspective;

receive a second dataset indicating a second surrounding with a second perspective;

generate a composite dataset from the first dataset and the second dataset; and

extract parameters describing a structure from the composite dataset, the parameters including at least one of a distance of the structure from the movable object, a location and a size of the structure, and motion of the structure;

determine that the structure is in a moving path of the movable object based on the extracted parameters;

identify the structure as an obstacle; and

cause the movable object to avoid the obstacle by altering the moving path of the movable object.

15. The system of claim 14 , wherein the first dataset includes a first image taken by a first movable object and the second dataset includes a second image taken by a second movable object.

16. The system of claim 14 , wherein the composite dataset contains three-dimensional information indicating at least one of a size or a location of at least one object.

17. The system of claim 14 , wherein the computing device is coupled to an unmanned aerial vehicle.

18. The system of claim 14 , wherein the detector is configured to generate the composite dataset from the first dataset and the second dataset by combining the first dataset and the second dataset using a structure from motion (SfM) algorithm.

19. The system of claim 14 , wherein at least a part of the second surrounding with the second perspective is not detectable by the first movable object.

20. The system of claim 14 , wherein the one or more processors is further configured to alter a moving path of the second movable object based on an altered moving path of the first movable object.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNEE'S COUNTRY PREVIOUSLY RECORDED AT REEL: 057661 FRAME: 0336. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 12, 2021
From: ZHOU, YOU; FENG, XUYANG; YAN, JIAQI; ZHAO, CONG
To: SZ DJI TECHNOLOGY CO., LTD
Reel/Frame 057776/0657 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2021
From: ZHOU, YOU; FENG, XUYANG; YAN, JIAQI; ZHAO, CONG
To: SZ DJI TECHNOLOGY CO., LTD
Reel/Frame 057661/0336 →
Continuity (2)
Continuation 16301356
Related Publication 20220035382A1 · Feb 3, 2022